iPhone 5 Galaxy S4 (Tagscape 001)

Crittercism, a mobile application performance management (APM) solution, has posted a new study this weekend entitled Mobile Experience Benchmark. The 19-page document covers several topics, but perhaps most interesting is the section on app stability.

The firm took a look at mobile application crashes on various versions of iOS and Android, running on a wide range of devices. And what it found was that on Apple’s platform, iOS 7.1 is the most stable, and on Google’s platform, Android Gingerbread is the least…

crittercism-ios-crash-rate

While it may not be too surprising that apps running on newer versions of mobile operating systems crash less than those on older versions, Crittercism’s study did uncover something unexpected: apps running on iOS are more likely to crash than apps on Android.

crittercism-android-crash-rate

Note that apps on iOS 6 crashed 2.5% of the time, and 2.6% on the iPad 2, and apps on Android Gingerbread and the Nexus 7 tablet each crashed 1.7% of the time. It’s also worth mentioning that the study only covers third-party apps, so  this doesn’t include stock titles.

Criterrcism has a fairly big reach, and is able to pull data from 1 billion devices. But this report certainly doesn’t take into account that over 80% of iOS users are on 7.0 or higher, which is likely much larger than the number of users on the latest Android versions.

Still, the report makes for an interesting read. You can find the whole thing here (via GigaOM).

  • shar

    I don’t understand this report, it says “iOS 7.1’s crash rate is 1.6%” and also says “KitKat, Ice Cream Sandwich and Jelly Bean’s crash rate is 0.7%” but then names “most” & “least” stable os, with iOS 7.1 being the most stable.

    • Melvco

      Note that the line “iOS 7.1 apps most stable” is on the chart that says ‘Apple OS and device breakdown.’

      I agree, the layout is strange, but I believe it shows that 7.1 is the most stable out of all iOS versions, but the combined crash percentages of iOS are worse than those of Android.

      • shar

        yes, though putting the titles this way probably wasn’t done without an agenda, otherwise we would have seen “iOS: xx most stable, Android: xx most stable” or “iOS: xx least stable, Android: xx least stable”.

  • Valent Cheung

    But this hasn’t counted the lagging/freezing of apps that only happens on Android

    • Chun-Li aka ThunderThighs

      Stop being a Apple fanboy and just go along with the statistics that are shown here. Hate when one side attacks another

      • jack

        You also should stop being a sheep and believing everything you read. I have both devicec (iPhone 5 and a HTC One) and I can guarantee it is the opposite this study shows.

        Hell, android has to deal with 3000 different hardware while iOS has only a few

      • jzack

        agreed

      • erod434

        “I can guarantee it is the opposite this study shows,” spoken like a true fanboy. And you’re calling him a sheep? Do you really believe that because you have had more crashes on your HTC One than your iphone that you can disprove a study done with over a BILLION devices? You cannot guarantee anything and your assumption shows that you only support the facts that affirm that the iphone is the best while in this aspect reality goes against you. The thing about ios is that when an app crashes it goes back to the home-screen so its almost unnoticeable while on android it says “this app has crashed.” so people actually notice it and developers can fix it.

      • Decio Arruda

        Why would anybody have an iPhone 5 and a HTC One?!?

      • Kash Gummaraju

        Why not?

      • jack

        Because I’m rich and I can afford them

      • iThinkergoiMac

        I have an iPhone 4S and a Galaxy Nexus, and the Galaxy Nexus crashes less (actually, I’ve never once had a single crash with the Galaxy). The iPhone is my personal phone and the Galaxy Nexus is my work phone. That being said, I do far more with my iPhone than my Galaxy, so it makes sense that the iPhone would have more problems.

        You can’t tell us that your single experience trumps data from over 1,000,000,000 devices. If nothing else, your experience vs my experience proves, beyond a shadow of a doubt, that your experience is not universal.

        There are certainly questions about the study’s validity, even the article says so. Why are you accusing people of being sheep when the only people in this thread that I’ve seen acting like sheep are those who are saying Apple devices don’t lag/freeze (they most certainly do sometimes) or that their personal experience is better and more to be trusted than stats from over 1 billion devices?

    • Elvin Topalov

      Once again, this is 2014. Stop using that same, lame excuse. All of the newer Android devices have no lag what-so-ever. And don’t say I’m an Android fanboy because I also have an iPad Mini with Retina Display and the iPhone 5 as my secondary driver.

      • Mozaik

        Sorry my friend but chrome on android has given me bad taste of android stutters and scrollin and zooming lag.

      • Elvin Topalov

        I use Chrome Beta so I’m not sure how the regular Chrome performs on Android, but since it is preinstalled on my phone, I’ve noticed that they have been constantly updating Chrome for performance issues and bugs.

      • smtp25

        Use Firefox. Chrome sucked use wise

    • Batman

      Wake the f*** up. It’s not 2010 anymore.

      • jzack

        i disagreed.. sorry batman

      • smtp25

        Have the sg4.. All these cores and still feels slow. I have one with snapdragon 600 So cant reflash to different ROM.

      • Batman

        Wrong choice. HTC One is buttery smooth. Sense UI is also a bonus

    • Sunny

      Please, get your hands on a Nexus 5 and see if there is any hanging/freezing, you must’ve had those cheap $30 android phones.

      • coLin

        I own a Nexus 7 retina, everything stock, I use it 10 min per day and still crashes and restarts randomly (not that often though)

      • Sunny

        I got a N7 2013 version too and i have no problems like you.. O.o what did you do to do that???
        I also just recently rooted mine too and even before that everything was smooth and dandy no crashes, maybe you downloaded a virus by downloading a pirated app?

      • coLin

        I don’t have pirated apps on my tablets, nor on my phone. I have just a few apps installed, so nothing is overloading. FB app (pretty often) gets stuck on loading the notifications while the browser works just fine and the email app as well.
        It might be just my unit
        I thought about rooting and install a custom ROM but I just don’t have the time to do that. can you recommend me a rom or a website?
        thanks

      • Sunny

        Since it’s Nexus, the stock android roms are always best, and yeah it is very likely your unit something abit dodgy with it, if you root i highly recommend installing Elemental X kernel (improved battery & performance) and i use Stock rom but another awesome and stable rom i recommend is Purity Rom.
        Root apps i highly recommend are Greenify, Ad away (blocks ads everywhere) & Xposed (it’s basically like cydia where you can get any tweaks you want directly, recommend Gravitybox [KK] )

        Well hopefully the next update will fix your N7, make sure to go into settings and go thorugh each and disable all those uneccessary stuff like NFC etc saving resources.

      • coLin

        Precious information. Thanks

    • -1

    • Kash Gummaraju

      You are the most ignorant person and probably illiterate when it comes to reading stuff. When an app freezes, the app has crashed and thus freezing is taken into account as crashing. Lagging happens on older specs and also if the system’s resources, such as battery, RAM, the CPU, are being overused. Explain to me how an entire operating system lagged(iOS 7) on an iPhone 4? Surely when it was the latest version of iOS it should’ve been the fastest and smoothest on all the devices right? What happened? Apple did fix the issue in 7.1, and if such an issue was noticed by Apple then it’s not an exception.

    • BozzyB

      “only” can’t be correct. I saw lagging more on idevices than on androids in the last 18 months. In fact I witnessed laggin on an iphone 4. The app froze for about 10 seconds (facebook slide menu)

    • Conrailgrille

      I agree…after using both for over a year, extensively, I would say the android lags and crashes much more.

  • Dan

    I’ve had my iPhone for a week, had a few crashes, but it’s most likely due to jailbreak tweaks. So far my iPad air (which I’ve had for a few months) hasn’t crashed. I think sms+ was the culprit.

  • jack

    “iOS crashes more than Android..” Riiiiiight.. In this extremely competitive market it is common to fraud studies and benchmarks, right Samsung?

    • Elvin Topalov

      So you’re going to tell me that if they said “iOS has no crashes and is superior in terms of stability”, you would believe that? That’s why I hate fanboys. Unless something says the company or OS you support is amazing and perfect, you freak out. Just accept the fact that Android is more stable than iOS. Anything can change tomorrow in this technology driven world.

      • jack

        I would believe it because Apple engineers both hardware and software to work together, while Android has hundreds of different hardware to support.

        Another reason is that Samsung was caught polluting forums with positive comments, and cheating benchmarks.

        FInally Samsung’s CEO Lee Kun-hee was found guilty of tax evasion and other crimes. So you wonder how dishonest they can play.

      • Elvin Topalov

        Exactly. You say Samsung, not the whole Android community. Samsung is terrible, it’s my least favorite OEM for smartphones matter of fact. But just because Samsung does something wrong doesn’t mean the whole Android community is.

      • jack

        My first argument didn’t mention Samsung…

      • Elvin Topalov

        I replied to your second argument, did I not? You only used Samsung as an example for the whole Android community.

      • Sgt. Faggot

        Actually, dumb-shit, both of them did. 🙂

      • Neil

        Your second one did though.. Get your life together.

      • Nice use of the word “evasion”

    • I love my iPad Air but because of the 1gig of RAM it crashes a lot. Crash report shows low memory crashes. Other than that it runs really well and I’m happy with it. For apps, surprisingly Safari is the biggest problem. Though that wasn’t included in this study. It has gotten better since I updated to 7.0.6. Hopefully it will get more stable as time goes on.

  • Lol

    I knew before even looking at comments that most would attempt to rubbish the findings since it’s not biased towards apple which is what the commenters want to see

    • Elvin Topalov

      Exactly how I feel. That’s the only thing that I hate about iDownloadBlog. They post stuff about non-iOS content occasionally and all it does is start a flame war for no reason. I know that this is some what related to iOS, but you know that this is something that would agitate apple fans.

      • lolder

        And that us the reason I stopped following idownloadblog. Before I would read all the articles and stuff but all the biased fanboys destroyed this blog. I’m Apple fan, own iPhone 5S, iPad Air, MacBook Pro the top one and I still disagree that Apple is the best

      • Antzboogie

        So what a little heated debate is no reason to become a hater because of a little aggression. Stop your crying and enjoy the show.

      • Don’t read the comments?

      • diggitydang

        I for one, love my Apple devices, but I’d rather hear the truth than just not hear it. I, for one, LOVE that iDB doesn’t just report on articles that praise Apple. I don’t believe that iDB does it just to start a war in the comments or irk it’s fans/followers… That would sorta be, ya know, counter-productive for a fan blog. I also love that they post articles that report on the new SGS5 or the HTC One (M8). I don’t want to be ignorant about everything else. Also, how do you expect to have an intelligent conversation about something if you only hear one side? To me, it’s like a religious person who preaches something but knows nothing about another religion. I say, keep it up iDB and thanks for reporting on everything, not just what’s good at Apple!

      • Elvin Topalov

        I agree with you but the comments that Apple fanboys write are so biased. I follow iDB mostly for their jailbreak news and other than that, I usually go on TechnoBuffalo for tech news. TechnoBuffalo does have fanboys there, too, but if you show most of the fanboys a valid argument, they will understand what you are trying to say and not just bash their skulls in with yours.

      • diggitydang

        Wait… Did I misunderstand you? Maybe I did. Nonetheless, my point still stands as an agreement to you, rather than a disagreement then… I think. Hahahaha.

      • Dan

        I agree. On pretty much any blog, people always stick by either android or Apple and trash the other side. It’s just a phone OS, no need to get riled up.

      • Antzboogie

        Let people vent out stop your crying debate even a heated one is good sometimes.

      • Dan

        I wasn’t crying, only agreeing to the other posters comment. By the way, a little punctuation goes a long way in helping people understand your post.

      • BozzyB

        I also like iDownloadblog because they bring topics from other OS which are related and start a discussion. It would be very poor only to focus on one thing and leave other (better) things aside just because you are a fan or you “love” a certain company (you shouldn’t do that either – this is sick and stupid. you should love you mom).

      • Elvin Topalov

        I understand that. Its not that I don’t want iDB to post content other than iOS or Apple, its just the comments that people write about the other content that kills me.

  • Mozaik

    The biggest flaws i see in this analysis is that samsung being the most stable devices , whereas even android users know how touchwiz is bad and most unoptimzed code of android. But stock android has gotten very good its smooth but not silky smooth as iOS and Windows Phone OS.

    • Dvoraak

      They’re looking at overall stability. Not lag time. Samsung’s feature spam creates lag, not instability.

      • Mozaik

        Lag is also a part of instability , my friend.

    • erod434

      So having actual facts that disprove you’re baseless assumption that touchwiz is “bad and most unoptimized code of android,” makes it flawed?

      • Kash Gummaraju

        It’s actually been proven that touchwiz is laggy. The skin takes up 8.6gb of storage- how is that not lag inducing?

      • erod434

        I never said that it isn’t laggy, just pointing out that it is absurd to disprove a study from over a billion devices with the claim that touchwiz is laggy from personal opinion. Also lag has nothing to do with an app crashing.

  • Dvoraak

    Both have impressively low crash rates.
    Enjoy your device of choice!

  • RarestName

    Seems like both are pretty stable after all!

  • Dean Johnson

    I think it would be better for everyone to just remove the comment section from posts that mention Android. The biggest fanboys from both sides come and start a war here

    • Kash Gummaraju

      Actually the only fanboys that started anything are the Apple ones. Many other fans of other mobile devices like to come here and read about Apple news, but when they see super biased comments against their opinions and likes, like every other person on the planet, they find the need to try and stop them.

  • Ben Stein

    Love the way Apple fans blame crashes only due to jailbreak, wake up! It would also crash without jailbreaking too!!!!

    • I Didn’t Do It

      …….no

      • grumpyfuzz

        Do you not understand? this study wasn’t used with jailbroken devices…

  • h4nd0fg0d

    I see no instability in regular apps on ios, never a crash. Now ios games have become quite a different story. With such discrepancies in hardware, games tuned for new devices suffer on older ones. One day a game will run like butter on my 5s and one game update later it’s completely broken due to detuning for old hardware. RAM, GPU, and firmware version differences have impacted gaming heavily. Devs need to abandon the older devices because the product is suffering tremendously.

  • TDD140

    I’m curious as to what Windows Phone 8’s crash rate is. From my experiences, Windows Phone 8 is quite smooth, and I haven’t experienced any crashes except for on the Nokia Lumia 1020. Even though Windows isn’t as popular as iOS and Android, it still should be included. Just my opinion.

    • I’d love to see more comparisons including WP8. It always gets really great reviews based on smoothness and stability. Only problem I hear is lack of apps and lack of certain features (all OSes lack this or that). But till it becomes more popular we won’t see much from them.

    • Sean Cua

      My lumia 520 crashes on apps that use a lot of memory.

      • TDD140

        Ah, that seems to be because it only has 512mb of ram to work with, so the RAM intensive apps don’t really allow the phone to do anything other than run that app. I had the same problem on my iPhone 4.

      • Sean Cua

        Yep! If there was a lumia 525 at the time I bought my phone I would’ve bought that one instead of the 520. Nevertheless, I love WP8.

  • quitcherbichinn

    One thing both sides should realize is that “a study” can be found to support any belief, be it true or not. “A new study shows” is the new catch phrase…it’s used constantly on the nightly news and the new studies on the same topics contradict one another from night to night. Take this type of stuff with a grain of salt.

    • Guest

      Exactly look at all the fake studies on Global warming. Oops we can’t call it that anymore. climate change. You know, al gore said in the winter of 2013 there would be zero ice on the polar caps yet we had record low temperatures and highest record ice in 75 years.

  • G-HaB

    So that chart basically states that iphone 5 crashes less then iPhone 5s that’s a first an older model crashing less?

  • @dongiuj

    My iPhone 5 and iPad retina since ios7 has become the most unstable I’ve seen on ios devices. Where android on many different devices is improving, ios on only apple devices are becoming more unstable. If there wasn’t an issue with stability on ios devices then this article would never have been made. I say made because it was most probably not written by iDB, just copy and pasted.

  • NIGGA NIGGA

  • FAK BITCH NIGGA

  • C0CK2323123 S1_1CKING 4PPL3 F4G5s

  • 1337 B1TCH

  • mav3rick

    Most of the iOS app crashes are due to devices hardware limitation, how cheap they’re build with so low memory resources. Devices from 4S and up should have at least 1GB memory as with every iteration iOS became more resource demanding.

  • Aric Bolf

    Good news then. Improvement every new version for both sides of the fence.

  • Conrailgrille

    i have been using both phones for a number of years. Android generally crashes more and allows apps to push more at you, making it more difficult to stop them. For example apps which have been removed will show up as running. Android generally doesn’t look as nice, the actual app icons, the menus etc.

  • Conrailgrille

    I find the android phones, large, clunky and made of cheaper materials. Also the menu and operating system are not as pleasing to the eye. The phone lacks the same uniform abilities to sync across all platforms and and purchases as easily as an iphone with mac devices. It is nice to have all the devices to have the same uniform look and made from the same high end quality components.

    The thing which is cheaper and more accessible to people will always be loved….I like that there are more people on android. enjoy whatever you like! Both products are pretty cool if you consider what was in our hands 10 years ago!