2012年6月10日星期日

Seen from the capture light and shadow - two three-point real-time filter innovation

Seen from the capture light and shadow - two three-point real-time filter innovation:

Speaking of "filter" this is no longer unfamiliar words. With the popularity of high-performance mobile terminals, and can automatically and quickly modified picture as a technology within a few short years has become the standard of a number of mobile terminals shooting applications. Shooting class applications, most of the filter still remains after the first shot of static processes, some of the applications for further real-time filter, but the filter process is not the user intervention in interactive, relatively homogeneous, the effect is rather monotonous.
In order to solve the filter can not be customized, single function, lack of interactivity, such as the lack of technology and experience, the the Tencent CDC development team and design team with the rendering technology infrastructure in high-definition real-time filter, a use of user gestures interact with the terminal to change the filter effects, real-time preview of the interface or shooting the solution is complete, change the filter effects, the camera application and pictures landscaping applications compared to traditional non-filter, take the finished product quality has been a huge upgrade, through this The kinds of technology to meet the needs of the users personalized and exchange, is also greatly reduced the cost of landscaping picture.

Gesture interaction DIY filter <br /> At present, both real-time filter or static filter, filter effects are non-custom, single function, we propose a new attempt to address this issue, the user through gestures and terminal interact with the terminal in response to user interactions, and to dynamically adjust the filter effects in the transformation process in the filter according to these user gestures. As shown below
Figure 1. Use the zoom gesture to adjust the fish-eye distortions strength size
Gestures by means of this interaction, we can terminal to dynamically change the effect of the filter, including the strength of the filter color concentration effects. Allows users with the most intuitive way to DIY your favorite filter effects, the filter processing will become an even more interesting, more personalized experience.
Figure 2. Translation gestures to control the color values ​​of the filter filtering

WYSIWYG real-time rendering
The filter processes the most photographed applications are selected in the first camera after taking pictures of each pixel data of the picture processing operator, the whole process depends on the terminal CPU serial computing, low processing efficiency, relying on such a program difficult to achieve Real-time dynamic preview filter.
To this end we use the OpenGL ES technology to image processing to the GPU. The graphics system uses a unique mechanism of pipeline (Pipeline) to compute the processing of image data, pixel processing in parallel, greatly enhance the efficiency, the OpenGL ES 2.0 allows to provide programming to control a number of important processes in the pipeline, including shader shader . The shader includes general operations on the vertex of the vertex shader, and allow normal operation of the fragment shader fragments. We use this part of the shader to write shader program the use of image processing algorithms to real-time processing of image data and outputs the result to reach real-time rendering can see from the filter effects.
Figure 3. For OpenGL ES 2.0 pipeline (Pipeline) mechanism

Seeing is believing, we recorded a demo video to show the above-mentioned filter innovation experience:


Bring a fast and convenient mobile terminal features greatly reduce camera cost, the end image processing performance upgrade to enhance a more brilliant image processing become possible. The CDC also continue to practice and try to experience and technical, the filter Image processing has become more friendly and efficient. Filter research and practice program will soon appear in the Tencent mobile end products such as Q shoot, so stay tuned and experience.
One more thing, the CDC real-time filter has been selected Tencent creative list of month May, check list, welcome to visit http://djt.qq.com/thread-29001-1-1.html participate in the vote in support of our research results (real-time filter is Drawing Number A), and have access to an annual fee to Blue Diamond :)
(This article comes from the Tencent CDC blog: http://cdc.tencent.com/?p=5695 )

没有评论: