Graphics

August 2010
Android for eReaders and

Smartbooks
CON-F0987
Sridharan Subramanian
Senior Product Manager Software and Platforms
Freescale, the Freescale logo, AltiVec, C-5, CodeTEST, CodeWarrior, ColdFire, C-Ware, mobileGT, PowerQUICC, StarCore, and Symphony are trademarks of Freescale Semiconductor, Inc.,
Reg. U.S. Pat. & Tm. Off. BeeKit, BeeStack, CoreNet, the Energy Efficient Solutions logo, Flexis, MXC, Platform in a Package, Processor Expert, QorIQ, QUICC Engine, SMARTMOS, TurboLink
and VortiQa are trademarks of Freescale Semiconductor, Inc. All other product or service names are the property of their respective owners. 2010 Freescale Semiconductor, Inc.
TM
Session Introduction
Overview
of Android and why is it relevant to the consumer
industry
Intermediate
Understand
level technical details of Android
the positioning of Freescale i.MX SoCs for
Consumer
High
level details of our implementation of Android on i.MX
TM
Agenda
Android Introduction
i.MX Roadmap
Android on i.MX Technical details
Optimizations
Review and Q&A
TM
Agenda
i.MX Roadmap
Optimizations
Review and Q&A
TM
What is Android?
A
free, open source and fully customizable software

platform and operating system for mobile devices
Based
on the Linux kernel
Offers
a full software stack: an operating system,

middleware, and key applications
Also
contains a rich set of APIs that allows third-party

developers to develop great applications
Developed
by Google and later the Open Handset

Alliance (OHA)
Allows
writing managed code in the Java language
Unveiling
of the Android platform was announced on

5 November 2007 with the founding of OHA
Android
is under version 2 of the Apache Software

License (ASL)
TM
What is Open Handset Alliance (OHA)?
A group of mobile and technology

leaders responsible for the creation and
proliferation of Android and an open
mobile ecosystem
Devoted
to advancing open standards for

mobile devices
Develop
technologies that will

significantly lower the cost of developing
and distributing mobile devices and
services
Freescale
joined OHA in early 2010
TM
Android Software Stack on Mobile Device

Apps (Java) Everyone
can create his/her own
application based on
Open Android API
Android Program API
Middleware (Java) App

framework including
window/focus management,
inter-app communication,
event notification, etc
Middleware (C/C++) system
libraries for media, graphic,
database, font, web engine,
etc
Android Porting I/F
2.6 based Linux kernel
with Android patch.
Open Source already
TM
Some Key Features of Android

Connectivity
Supports connectivity technologies including GSM/EDGE, CDMA, EV-DO, UMTS,

Bluetooth, and Wi-Fi
Web
browser
Web browser available in Android is based on the WebKit application framework
Media
Supports some audio/video codecs
Hardware
Can use video/still cameras, touchscreens, GPS, accelerometers, magnetometers,

accelerated 2D bit blits and accelerated 3D graphics
Android
Market place
Catalog of applications that can be downloaded and installed to target hardware

over-the-air, without the use of a PC
Dev
and graphics
environment
Includes a device emulator, tools for debugging, memory and performance profiling
TM
Examples of Kernel Enhancement

Binder
(Android IPC support)
PMEM
ASHMEM
Logger
Power
USB
gadget
Low Memory Killer
For details:
http://developer.android.com/reference/android/os/Binder.html
http://cs736-android.pbworks.com/
TM
Android Software Development Kit and Tools

Android
SDK
Class Library
Developer Tools
dx Dalvik Cross-Assembler
aapt Android Asset Packaging Tool
adb Android Debug Bridge
ddms Dalvik Debug Monitor Service
Emulator and System Images

Documentation and Sample Code
Eclipse
IDE + ADT (Android Development Tools)
Reduces Development and Testing Time

Makes User Interface-Creation easier
Makes Application Description Easier
TM
Past Android Releases

1.5 (Cupcake)
On 30 April 2009, the official 1.5 (Cupcake) update for
Android was released
1.6 (Donut)
On 15 September 2009, the 1.6 (Donut) SDK was released
2.0/2.1 (Eclair)
On 26 October 2009, the 2.0 (Eclair) SDK was released
On 3 December 2009 the 2.0.1 SDK was released
On 12 January 2010 the 2.1 SDK was released
2.2 (FroYo)
On 20 May 2010, the 2.2 (FroYo) SDK was released
TM
Android FroYo and Gingerbread Source Wikipedia

2.2 (Froyo)
Based on Linux Kernel 2.6.32
Gingerbread
Based on Linux Kernel 2.6.33
or 34
On 20 May 2010 the 2.2 (Froyo) SDK was released. Changes included:
* General Android OS speed, memory, and performance optimizations
* Additional application speed improvements courtesy of JIT implementation
* Integration of Chrome's V8 JavaScript engine into the Browser application
* Increased Microsoft Exchange support (security policies, auto-discovery, GAL lookup, calendar synchronization, remote wipe)
* Improved application launcher with shortcuts to Phone and Browser applications
* USB tethering and WiFi hotspot functionality
* Support for file upload fields in the Browser application
* Support for installing applications to the expandable memory
* Adobe Flash 10.1 support
Tentatively scheduled for Q4 launch. Confirmed new features:
Support for WebM video playback
Improved copypaste functionalities
Unconfirmed new features:
Android Market music store
Media streaming from PC library
Revamped UI
Support for bigger screens with up to Wide XGA (1366768) resolution
Source will be released after SDK release in Q4 - Date TBD - expected in Dec
TM
12
Agenda
i.MX Roadmap
Optimizations
Review and Q&A
TM
13
Enabling the Multimedia Experience

Portable Media
Players
eReaders
Advanced
Smartphones
Smartbooks
Tablets
Display Centric
Connected Devices
Auto
Photo
Frames
Infotainment/
Telematics
Mobile
Medical
Home
Industrial
Energy
Gateways
Media
Phones
Touch Screen
Printers
Trends driving need for a intuitive,

rich user experience with seamless
connectivity. See it and touch it
Proliferation of tablet centric devices
Content centric
Instant on and always connected
Great user experience
Requirements:
Optimized performance-power-cost
Open OS support with complete solution

including reference designs
Strong ecosystem and partners
Ease of use for fast time to market
Mobile Internet
Devices
Smart processing solutions

for the connected world
TM
14
Applications Processors (i.MX) Roadmap
i.MX53
Next Gen
family
High tier smartbook
i.MX51
Next Gen
family
Next gen
Smartbook
Smartphone
Cortex-A8, 1 GHz
1080p video
2D/3D graphics
DDR2/3 800 MHz
Cortex-A8, 800MHz
Video (720p dec)
Graphics
512MB DDR2
i.MX508
Next Gen
eReader
2009
Cortex-A8, 800 MHz

Graphics
E INK display Controller
512MB LP-DDR2
2011
2010
C90 i.MX Platform

C90/C85 STMP
Platform
C65 A8 Platform
TM
15
Freescale Android Value Add and Roadmap
Integrated and tested solution
Performance Optimization
Kernel + Android framework + codecs + development/debug environment
Hardware acceleration for graphics and multimedia

Optimized OpenMax and OpenGL/ES with on chip VPU/GPU
New release ~ every two months

June
2009
Aug
July
Sep
Oct
Nov
Started work
from late 2008
R3 (Q2)
R4 (Q3)
R5 (Q3)
R6 (Q4)
Cupcake
Donut;
Donut
Donut
2010
Jan
Mar
Feb
Apr
May
Jun
R7 (Q1)
R7.1 (Q1)
R8 (Q2)
R9 (Q3)
clair
clair
Eclair
FroYo
2010
Aug
Sep
Oct
Nov
Dec
2011
Jan
Dec
July
Feb
Regular cadence of updates

TM
Agenda
i.MX Roadmap
Optimizations
Review and Q&A
TM
17
What We Did for Android on i.MX - Kernel Porting
TM
What We Did for Android on i.MX Connecting kernel with Android
TM
19
What We Did for Android on i.MX Tuning for Higher Performance
TM
20
Android for eReader

Android
was designed for smartphones with LCD interfaces which does not allow
for application decisions to overcome the EINK challenges
Screen size is limited to phone resolutions (<6"); eReaders are much larger (6"-11")
EPD displays have very slow refresh rates (~1s); Android requires 3D rendering and
other graphics required for a rich internet experience
Android Applications can not run on eReaders due to slow screen refresh rates
All eReader Apps must be tuned to function on the slow screen
Developers
of eReaders in Android must modify the framework and application to

work smoothly on an eINK display. By the time the modifications are complete, it
no longer looks like Android
Android Modifications Modifications to display framework, surface flinger and views to

allow application control over display updates
Developers
prefer Android for the following reasons:
Development platform for tools and community involvement

Easy integration of network stacks and other services
Leverage applications
TM
eReader eInk BSP layer
Programming Model Standard Framebuffer call

with extensions for control over update
Simple
Allows application control over screen region, update mode (full or

partial) and waveform mode
Framebuffer driver manages active update lists and collision events
Wait for completion available for synchronization of updates
PXP hardware acceleration
RGB to greyscale color space conversion

Rotation, scaling and blending
Histogram to support automatic waveform mode detection
TM
22
Agenda
i.MX Roadmap
Optimizations
Review and Q&A
TM
23
Extensive Optimizations in Multimedia
Incorporated audio codecs optimized specific for

Cortex-A8/Neon
Incorporated video accelerator to enable 1080p/720p

playback
Incorporated video accelerator to enable 720p/D1

camcording
Video rendering
Rendering video through overlay instead of the SurfaceFlinger (UI)
Video overlay is accelerated by hardware
Frame buffers are shared between the decoder and renderer so avoid
memory copy
TM
24
Extensive Enhancements in Multimedia
Added more formats: AVI, MKV, FLV, ASF and RM
Added more codecs: WMV7/8/9, WMA, Ogg Vorbis and

AC3 decoders
Added MP3 for audio encoding
TM
25
Video Playback Performance Comparison Between

Un-optimized and Optimized Android
Container
Video
Audio
MPEG-4
MP4
AAC-LC
H.264
Resolution/
Framerate
CPU loading
Original
Frame Dropping Rate
Optimized
Original
Optimized
320x240/30
56.5%
7.3%
640x480/30
96.5%
8.7%
7.4%
720x576/30
>97%
9.2%
27%
1280x720/30
N/A
11%
N/A
320x240/30
79.6%
7.0%
640x480/30
N/A
7.6%
N/A
720x576/30
N/A
8.2%
N/A
1280x720/30
N/A
11.2%
N/A
Notes
The test is carried out on Freescale Babbage 3.0 board with WVGA output
N/A means this specification is not supported
The original Android supports MPEG-4 up to VGA and H.264 up to CIF with acceptable quality
Freescale version with optimization supports MPEG-4 and H.264 up to 720p without frame dropping
TM
26
Multimedia Audio/Video Codec

APPLICATIONS
Audio/Video Apps
APP FRAMEWORK
MediaPlayer/Recorder Class
RUNTIME -> NATIVE
JNI
NATIVE LIBRARIES
IPC binding
MediaPlayer Service (Native)
Media Library
PV OpenCore Player/Author Engine

PV MediaInput
Node
PV SW
Codec/Parser
PV MediaOutput
Node
FSL OMX Core
OpenMAX IL I/F
FSL Audio Codecs

with OMX IL
FSL Video Codecs with

OMX IL
LINUX KERNEL
VPU Driver
TM
27
i.MX standard Audio/Video Decoders

File Extension
.mp3
.aac/.adts
.mp4
Video Decoders
MP4V:MPEG-4 SP/ASP except GMC

H264:H.264 BP/MP/HP
H263
.m4a
.3gp
.avi
.mkv/mka
.flv
AAC LC/PLUS
MP3
AAC LC/PLUS

H264:H.264 BP/MP/HP
H263
Xvid
H264:H.264 BP/MP/HP
H263
Divx4/5/6
.wma
.wmv/.asf
Audio Decoders
MPEG-1 Audio Layer I/II/III
AAC LC/PLUS
AAC LC/PLUS
AMR-NB
AAC LC/PLUS
MP3
WMA STD, PRO, Lossless
VC1: VC-1 SP/MP/AP

WVC1
WMV7, 8
H264:H.264 BP/MP/HP
Xvid
Divx4/5/6
VC1: VC-1 SP/MP/AP
MPEG4
Sorenson H263
H264:H.264 BP/MP/HP

AAC
MP3
Vorbis
MP3
AAC
TM
28
i.MX standard Encoders and Restricted Codecs

File Extension
Video Encoders
Audio Encoders
.3gp
H263
AMR-NB
.mp4
H264
MP3
Restricted Codecs
File Extension
Video Decoders
Audio Decoders
.avi
DivX3
AC3
RA6
RA9/10 (AAC-LC)
.ra
.rm/rmvb
RV8/9/10
RA6 (Up to 2 audio channel)

RA9/10 (AAC-LC)
.mkv/.mka
RV8/9/10
DivX3
AC3
RA6 (Up to 2 audio channel)
RA9/10 (AAC-LC)
TM
29
Extensive Enhancements for Graphics and Other Modules

Incorporated
the GPU for 3D processing
UI optimizations
3D applications
Hardware
Bitblt to combine surfaces into the display buffer
Multiple
overlay (to support V2IP)
Multiple
media storage
Recovery
on EXT3/SD
TM
Android Graphic Modules

SurfaceFlinger
Provides a system-wide surface composer to render all the surfaces in a frame

buffer.
SF Combines 2D and 3D surfaces.
SF uses OpenGL ES and 2D hardware accelerator for its compositions.
SKIA
Skia is a complete 2D graphic library for drawing Text, Geometries, and Images.
3x3 matrices w/ perspective.
antialiasing, transparency, filters.
shaders, xfermodes, maskfilters, patheffects.
HW
Blit Engine
HWBlit is a GPU accelerated 2D blit engine for fast bitmap copying, rotation,
alpha blending, dithering and other 2D effects.
TM
Android 2D Graphic
2D Application
Processes
App
1
SKIA draws a
filled rectangle
SKIA generates
font BMP from text
Surface
-1
Surface
-1
Surface
-2
Internal Process
Communication
Apps post
surfaces to
SurfaceFlinger
Surface
composition via
SurfaceFlinger
SF binds
surfaces as
texture via SW
GLES
SW GLES
composites all
textures to
framebuffer via
HWBlit
Surface
-1
Texture1
Surface
-2
Texture2
Surface
-3
Texture3
HWBlit
acceleration via
GPU 2D core
HWBlit
texuture2 to FB
HWBlit
texuture3 to FB
HWBlit
texuture1 to FB
App
2
Surface
-3
TM
Android 3D Graphic
3D Application
Processes via
GPU 3D core
3D App binds
3D App allocates
surface-2 with
surface-2
HW GLES
2D App
(status bar)
Internal Process
Communication
3D App uses
GLES APIs to
draw 3D
content to
surface-2
Apps post
surfaces to
SurfaceFlinger
Surface
composition via
SurfaceFlinger
SF binds
surfaces as
texture via
SW GLES
SW GLES
composites all
textures to
framebuffer via
HWBlit
HWBlit
acceleration via
GPU 2D core
HWBlit
texuture1 to FB
HWBlit
texuture2 to FB
Surface
-1
Surface
-1
Texture1
Surface
-2
Texture2
3D App
Surface
-2
TM
3DMM gaming
Samurai
Z430 clock = 166MHz

Screen Resolution = 800x480 full screen,16bpp(WVGA RGB565)
Memory = DDR200
Average FPS = 34 frame
TM
Agenda
i.MX Roadmap
Optimizations
Review and Q&A
TM
35
Key Messages
Android is a free, open source and fully customizable software platform and
operating system for mobile devices Gained tremendous market share

Freescale enables customers with integrated hardware/software solutions to realize
faster time to market. The Android platform provides a compelling and

innovative end user experience to support this effort
The i.MX5x processor
family with Android is a full hardware and software

solution that is ideal for high performance, low power and cost effective
mobile devices, including smartphones and other smart mobile devices such as
smartbooks and eReaders
The Android solution for i.MX is fully optimized and integrated with the video and
graphics hardware accelerators

Freescale is a member of the Open Handset Alliance
TM
36
Learn More On
http://www.freescale.com/imxandroid
TM
37
www.iMXcommunity.org
A Freescale supported open web community of developers sharing
common interest in transforming i.MX applications processors into
practically anything imaginable.
i.MX Community
Serves all component enablement peripherals including basic to complex software
i.MX Forums, Groups and Blogs Posts
News, Photos and Videos
Training, Events and Promotions
Check it out!
Become a member today and you will be entered to win a i.MX development system of your choice.
Drawing will be held on June 30th.
TM
38
TM

Graphics

Încărcat de

Informații document

Drepturi de autor

Formate disponibile

Partajați acest document

Partajați sau inserați document

Opțiuni de partajare

Vi se pare util acest document?

Este necorespunzător acest conținut?

Drepturi de autor:

Formate disponibile

Graphics

Încărcat de

Drepturi de autor:

Formate disponibile

August 2010

Android for eReaders and

of Android and why is it relevant to the consumer

level technical details of Android

the positioning of Freescale i.MX SoCs for

level details of our implementation of Android on i.MX

Android on i.MX Technical details

Review and Q&A

Android on i.MX Technical details

Review and Q&A

free, open source and fully customizable software

on the Linux kernel

a full software stack: an operating system,

contains a rich set of APIs that allows third-party

by Google and later the Open Handset

writing managed code in the Java language

of the Android platform was announced on

is under version 2 of the Apache Software

What is Open Handset Alliance (OHA)?

A group of mobile and technology

to advancing open standards for

technologies that will

joined OHA in early 2010

Android Software Stack on Mobile Device

Middleware (Java) App

Some Key Features of Android

Supports connectivity technologies including GSM/EDGE, CDMA, EV-DO, UMTS,

Web browser available in Android is based on the WebKit application framework

Supports some audio/video codecs

Can use video/still cameras, touchscreens, GPS, accelerometers, magnetometers,

Catalog of applications that can be downloaded and installed to target hardware

Examples of Kernel Enhancement

(Android IPC support)

Android Software Development Kit and Tools

Emulator and System Images

IDE + ADT (Android Development Tools)

Reduces Development and Testing Time

Past Android Releases

Android FroYo and Gingerbread Source Wikipedia

Android on i.MX Technical details

Review and Q&A

Enabling the Multimedia Experience

Trends driving need for a intuitive,

Proliferation of tablet centric devices

Instant on and always connected

Great user experience

Open OS support with complete solution

Strong ecosystem and partners

Ease of use for fast time to market

Smart processing solutions

Applications Processors (i.MX) Roadmap

High tier smartbook

Cortex-A8, 800 MHz

C90 i.MX Platform

Freescale Android Value Add and Roadmap

Integrated and tested solution

Kernel + Android framework + codecs + development/debug environment

Hardware acceleration for graphics and multimedia

New release ~ every two months

Regular cadence of updates

Android on i.MX Technical details

Review and Q&A

What We Did for Android on i.MX - Kernel Porting

What We Did for Android on i.MX Connecting kernel with Android