Overview of Android Camera2 Image Capture and Face Recognition Pipeline

This document provides a comprehensive overview of the 2D face‑recognition image‑capture component used in Android devices. It explains that most Android phones employ a 2D face‑recognition approach that only requires RGB images, which can be obtained with a standard camera module.

1. Camera Component Architecture – The architecture diagram (Figure 1) shows the Camera HAL, the new Camera v2 API introduced in Android 5.0, and the ability to output RAW images and control focus, exposure, and other parameters.

2. Camera Data Flow – Figure 2 illustrates the overall model of the Camera pipeline, while Figure 3 details the processing steps from the Camera sensor to the final image. The document describes the YUV_420_888 format, the three planes (Y, U, V), their stride and pixel layout, and how to extract pixel data using AImage_getPlaneData .

3. Capture and Preview – The capture flow is described step‑by‑step: the application creates an ImageReader via initImageReader() , registers onImageAvailable callbacks, and obtains images with AImageReader_acquireNextImage . The capture request is built with CaptureRequest.Builder , for example: captureBuilder.set(CaptureRequest.CONTROL_AF_MODE, CaptureRequest.CONTROL_AF_MODE_CONTINUOUS_PICTURE);

The preview is driven by setRepeatingRequest on a Surface resource that is passed through the Face framework to the HAL.

4. Detailed Capture Process – The sequence includes opening the camera with ACameraManager_openCamera , creating an ACaptureSessionOutputContainer , adding ACaptureSessionOutput objects, and invoking cameraHelper.takePicture() . The document also discusses error handling for connection failures, permission issues, and busy resources.

5. Surface Resource Transmission – The Surface created by the app is converted to a native_handle_t via makeFromAidl and passed to the HAL. The flow involves several components: FaceManager , FaceService , FaceProvider , and FaceHAL . Code snippets illustrate how the native handle is defined and used.

6. References and Tools – The article lists useful links such as the Android OpenGrok source search, the Camera service repository, and the Google Android source documentation for camera devices.