This document discusses Android automation and introduces Magneto, an open source Android UI testing framework. It summarizes Magneto's benefits over other frameworks including being easy to set up, supporting asynchronous waits to avoid flaky tests, providing logs, screenshots and videos of failed tests for debugging, and giving full control over devices via ADB commands. The document encourages forking and contributing to Magneto on GitHub and notes the company EverythingMe is hiring experienced Android developers and automation engineers.

2. Android Automation
next level sh****t

3. Heyo!
I’M RAN BEN AHARON
Android & Automation lead @EverythingMe
ran@everything.me
ranbena.com

5. Pain
Mobile development is not easy

6. FIXED A TYPO
NOW APP CRASHES
IN PRODUCTION

7. RELEASE DAY
SCARED SHITLESS

8. DREAMED OF
BUILDING APPS
NOW I CAN’T SLEEP

9. “In order to move fast -
you need good brakes

10. We love open source
at EverythingMe we utilize,
create and contribute

11. Open source Android automation
Cost
Community
Our own fork
Appium
Calabash
Espresso
MonkeyTalk
Robotium
Selendroid
...

12. How the big boys do it
ebay
Calabash (ruby)
Mozilla
Robocop (java)
Soundcloud
Robotium (java)
Facebook
Selendroid (java)
Yelp
Espresso (java)
Groupon
RoboRemote (java)

13. Struggling to
make it work
Gaining and maintaining trust

14. Distrust and disengagement
Unreliable results
Not part of the release flow
No visibility
Cumbersome tools

15. Trust and cooperation
Reliable results
Part of the release flow
Full visibility
Delightful tools

17. We’re hiring an
Automation engineer
?

18. “

19. What’s so special
about
Yet another UI testing FW?

20. Fits our needs
Faster
Leaner
Reliable results
Python goodness
Lots of essential test methods

21. 1.
Setup was a big hassle

22. 1.
Setup was a big hassle
Magneto is easy to install and run

23. $ pip install magneto
Install
$ magneto run [tests_path]
Run
Boilerplate
$ magneto init [package]

24. Example test
def test_button(self):
# and click button
button = self.magneto(text='Click me')
button.click()
# scroll list
list = self.magneto(className='android.widget.ListView')
list.fling.toEnd()
# make sure last item exists
last_item = self.magneto(text="last item")
Assert.true(last_item.exists)

25. 2.
Time sleeps caused
flaky results

26. 2.
Time sleeps caused
flaky results
Magneto is truly ready for async

27. wait_for_element
wait for an element to appear

28. # wait for button
button = self.magneto.wait_for_element(text=’click’)
# make sure it’s there
Assert.true(button.exists)
wait for button to appear

29. wait_for_true
wait for a function to return True

30. # click button
self.magneto(text=’Click me’).click()
# wait for text to change
self.magneto.wait_for_true(lambda:
button.info[‘text’] != ‘Click me’
)
wait for button text to change

31. Assert.current_package
wait for package to focus

32. # tap chrome icon
self.magneto(text=’Chrome’).click()
# wait for chrome to open
Assert.current_package(‘com.android.chrome’)
wait for chrome to open

33. ADBLogWatch
Tune in to logcat

34. # install app
with ADBLogWatch() as w:
w.watch(‘android.intent.action.PACKAGE_ADDED’)
ADB.install(‘apps/facebook.apk’)
w.assert_done()
# make sure it’s on homescreen
app = self.magneto(text=’Facebook’)
Assert.true(app.exists)
wait for app to be installed

35. 3.
Stats were hard to trace

36. 3.
Stats were hard to trace
Using logcat for immediate feedback

37. # click button
with ADBLogWatch() as w:
w.watch(‘Stat1 sent’)
self.magneto(text=’click’).click()
w.assert_done()
assert stat

38. # click button
with ADBLogWatch() as w:
w.watch(‘Stat1 sent’)
w.watch(‘Stat2 sent’)
self.magneto(text=’click’).click()
w.assert_done()
assert multiple stats

39. # click button
with ADBLogWatch() as w:
w.watch(‘Stat sent’,screen=’home’,action=’click')
self.magneto(text=’click’).click()
w.assert_done()
assert stat params

40. 4.
Failed tests were unclear

41. 4.
Failed tests were unclear
Magneto supplies screenshots, videos...

42. $ magneto run --save-data-on-failure
Save test fail data

43. $ magneto run --save-data-on-failure
--include-video-on-failure
Save test fail data

44. - 3-test_name-time.hierarchy.uix
- 3-test_name-time.screenshot.png
- 3-test_name-time.logcat.log
- 3-test_name-time.video.mp4
- 12-test_name-time.hierarchy.uix
- 12-test_name-time.screenshot.png
- 12-test_name-time.logcat.log
- 12-test_name-time.video.mp4
Failed tests artifacts

45. 5.
Device
miscommunication

46. 5.
Device
miscommunication
Magneto gives you ADB power

47. ADB.install(apk_path)
ADB.uninstall(app_package)
ADB.start_activity(app_package, app_activity)
ADB.kill_process(app_package)
ADB.exec_cmd(command)
ADB.set_date(date)
ADB.getprop(prop)
ADB.get_log()
ADB.clear_log()
ADB power

48. 6.
Painful debugging

49. 6.
Painful debugging
iMagneto + UiAutomatorViewer

50. $ imagneto
In magneto(text=”click”).click()
In magneto.orientation = “r”
In f = magneto(resourceId=”el”)
In f.info
imagneto

51. Much more!
Skipping, tagging, blocking
Fragmentation handling

52. The FUTURE
It’s gonna get osom

53. Fail on GC

54. Fail on log > n

55. Web inspector?

56. Non-active windows

57. Docs

58. Known limitations
○ Android 4.2+
○ Sequential UI actions only

59. FORK and
CONTRIBUTE
http://github.com/EverythingMe/magneto

60. “
http://mobileautomators.com

61. We’re Hiring!

62. We’re Hiring!
Experienced Android Dev

63. We’re Hiring!
Experienced Android Dev
Automation Engineer

64. We’re Hiring!
Experienced Android Dev
Automation Engineer
jobs@everything.me

65. Come talk to us
Experienced Android Dev
Automation Engineer
jobs@everything.me

67. THANKS!
Any questions?
ran@everything.me
geeks.everything.me
ranbena.com