Testing 4G Ahead of the Curve

1
Testing 4G Ahead of the Curve

• Automation, is it even an option?

2
4G Technical Benefits
Source Motorola
3
4G Technical Benefits
Source Motorola
4
4G Business Benefits

• Expanded Services New Services Less Cost
• More Revenue
• The Next Chapter in the
• War for subscribers

5
Companies already in Trials
6
4G is Complex
Source Kineto Wireless
7
4G is Another Layer
Source Alcatel-Lucent, Fibresystems.org
8
4G Complexity is Daunting
9
New Technology Equals Churn

• New Devices / Standards - Daily
• High Feature Velocity
• Rapid bug fix releases

This makes an already challenging problem quite
frustrating
10
Test Area
Hardware and Interfaces
Software and Interfaces

• Application Interactions
• With and without network interaction)
• Application running from Memory Card
• Flight Mode
• Concurrency e.g.
• Mobile TV and incoming call
• Write SMS and incoming call
• Receive SMS/MMS during Call
• Receive call while any of the applications is
  running
• Video Conference and MMS
• Streaming service and incoming/outgoing call
• Upload data and and incoming/outgoing call
• ...

• Formfactors / Design
• FPGA
• Processors
• Display
• Keypad
• Touchscreen
• Camera
• Microphone
• Battery and Charger
• Data Cables (Video, USB)
• Headset
• Headset Bluetooth
• Lamp
• Storage
• Data Card (removable)

• Radio Interface (RF)
• physics control
• En-/Decoding
• Throughput
• IR
• Bluetooth
• WiFi
• FM Radio
• GPS
• Additional keys for e.g.
• Loudness
• Camera
• Switch on/off
• Sensors (if applicable)

• Applications without network interaction
• Music
• Gaming
• Java
• Phonebook
• Calendar
• Clock / Alarm / Worldclock
• Editor
• Document viewer
• Caculator
• Currency converter
• GPS
• Radio FM

• Layer 2/3 Protocol Testing (Network Signaling)
• GSM/GPRS/EDGE
• UMTS/HSPA
• LTE (example follows)
• Module Testing
• HW/SW Integration
• System Integration
• 2G/3G Mobility
• IntraRAT-Handover
• InterRAT-Handover
• Protocol Conformance Testing ( -gtGCF)

• Services e.g.
• Supported Bearers
• SIP / IMS applications (as VoIP !!)
• MBMS (as Mobile TV)
• Different Qos/QCI (QoS class Identifier in LTE)
• Bearers in parallel
• Supplementary services (CLIP/CLIR...)
• Location Based Services
• Throughput measurements
• Performace Testing
• IODT
• IOT
• Drive / Field tests
• Type Approval

• Platform Capabilities
• Operating System (S60, Windows Mobile etc)
• Platform SDK
• Security
• Audio
• Quality
• Codecs
• Voice recording
• Speech recognition (Voice dialling)

• Video
• Quality
• Codecs
• Video recording
• Content and File Management
• DRM
• File Manager
• Data transfer via BT, IR, USB
• Graphics

• Applications with network interaction
• Mobile TV
• SMS
• MMS
• Download, upload files, pictures, videos
• Interactive gaming
• Calendar synchronisation
• Email
• Push to talk
• Web browsing
• WAP
• Call Register (in / out / missed)
• VoIP
• IPv6

11
Testing Ahead of 4G

• 4G is another order magnitude on top of the
  existing infrastructure
• Profitability and company viability on the line.
• Unbelievable Technology Churn
• Less ability to test manually
• Script based testing is failing

12
Will Your 4G be on Time?

• Can you take a feature test and get it into
  regression before you release the product or
  service?
• Can you run a full regression suite on a new
  service, new device feature, or a device software
  update in less than a week? In two days?
• No? Better hope your competitor cant