aboutsummaryrefslogtreecommitdiffstats
path: root/Documentation/usb/sn9c102.txt
diff options
context:
space:
mode:
Diffstat (limited to 'Documentation/usb/sn9c102.txt')
-rw-r--r--Documentation/usb/sn9c102.txt480
1 files changed, 480 insertions, 0 deletions
diff --git a/Documentation/usb/sn9c102.txt b/Documentation/usb/sn9c102.txt
new file mode 100644
index 000000000000..cf9a1187edce
--- /dev/null
+++ b/Documentation/usb/sn9c102.txt
@@ -0,0 +1,480 @@
1
2 SN9C10x PC Camera Controllers
3 Driver for Linux
4 =============================
5
6 - Documentation -
7
8
9Index
10=====
111. Copyright
122. Disclaimer
133. License
144. Overview and features
155. Module dependencies
166. Module loading
177. Module parameters
188. Optional device control through "sysfs"
199. Supported devices
2010. How to add plug-in's for new image sensors
2111. Notes for V4L2 application developers
2212. Video frame formats
2313. Contact information
2414. Credits
25
26
271. Copyright
28============
29Copyright (C) 2004-2005 by Luca Risolia <luca.risolia@studio.unibo.it>
30
31
322. Disclaimer
33=============
34SONiX is a trademark of SONiX Technology Company Limited, inc.
35This software is not sponsored or developed by SONiX.
36
37
383. License
39==========
40This program is free software; you can redistribute it and/or modify
41it under the terms of the GNU General Public License as published by
42the Free Software Foundation; either version 2 of the License, or
43(at your option) any later version.
44
45This program is distributed in the hope that it will be useful,
46but WITHOUT ANY WARRANTY; without even the implied warranty of
47MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
48GNU General Public License for more details.
49
50You should have received a copy of the GNU General Public License
51along with this program; if not, write to the Free Software
52Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA.
53
54
554. Overview and features
56========================
57This driver attempts to support the video and audio streaming capabilities of
58the devices mounting the SONiX SN9C101, SN9C102 and SN9C103 PC Camera
59Controllers.
60
61It's worth to note that SONiX has never collaborated with the author during the
62development of this project, despite several requests for enough detailed
63specifications of the register tables, compression engine and video data format
64of the above chips. Nevertheless, these informations are no longer necessary,
65becouse all the aspects related to these chips are known and have been
66described in detail in this documentation.
67
68The driver relies on the Video4Linux2 and USB core modules. It has been
69designed to run properly on SMP systems as well.
70
71The latest version of the SN9C10x driver can be found at the following URL:
72http://www.linux-projects.org/
73
74Some of the features of the driver are:
75
76- full compliance with the Video4Linux2 API (see also "Notes for V4L2
77 application developers" paragraph);
78- available mmap or read/poll methods for video streaming through isochronous
79 data transfers;
80- automatic detection of image sensor;
81- support for any window resolutions and optional panning within the maximum
82 pixel area of image sensor;
83- image downscaling with arbitrary scaling factors from 1, 2 and 4 in both
84 directions (see "Notes for V4L2 application developers" paragraph);
85- two different video formats for uncompressed or compressed data in low or
86 high compression quality (see also "Notes for V4L2 application developers"
87 and "Video frame formats" paragraphs);
88- full support for the capabilities of many of the possible image sensors that
89 can be connected to the SN9C10x bridges, including, for istance, red, green,
90 blue and global gain adjustments and exposure (see "Supported devices"
91 paragraph for details);
92- use of default color settings for sunlight conditions;
93- dynamic I/O interface for both SN9C10x and image sensor control and
94 monitoring (see "Optional device control through 'sysfs'" paragraph);
95- dynamic driver control thanks to various module parameters (see "Module
96 parameters" paragraph);
97- up to 64 cameras can be handled at the same time; they can be connected and
98 disconnected from the host many times without turning off the computer, if
99 your system supports hotplugging;
100- no known bugs.
101
102
1035. Module dependencies
104======================
105For it to work properly, the driver needs kernel support for Video4Linux and
106USB.
107
108The following options of the kernel configuration file must be enabled and
109corresponding modules must be compiled:
110
111 # Multimedia devices
112 #
113 CONFIG_VIDEO_DEV=m
114
115 # USB support
116 #
117 CONFIG_USB=m
118
119In addition, depending on the hardware being used, the modules below are
120necessary:
121
122 # USB Host Controller Drivers
123 #
124 CONFIG_USB_EHCI_HCD=m
125 CONFIG_USB_UHCI_HCD=m
126 CONFIG_USB_OHCI_HCD=m
127
128And finally:
129
130 # USB Multimedia devices
131 #
132 CONFIG_USB_SN9C102=m
133
134
1356. Module loading
136=================
137To use the driver, it is necessary to load the "sn9c102" module into memory
138after every other module required: "videodev", "usbcore" and, depending on
139the USB host controller you have, "ehci-hcd", "uhci-hcd" or "ohci-hcd".
140
141Loading can be done as shown below:
142
143 [root@localhost home]# modprobe sn9c102
144
145At this point the devices should be recognized. You can invoke "dmesg" to
146analyze kernel messages and verify that the loading process has gone well:
147
148 [user@localhost home]$ dmesg
149
150
1517. Module parameters
152====================
153Module parameters are listed below:
154-------------------------------------------------------------------------------
155Name: video_nr
156Type: int array (min = 0, max = 64)
157Syntax: <-1|n[,...]>
158Description: Specify V4L2 minor mode number:
159 -1 = use next available
160 n = use minor number n
161 You can specify up to 64 cameras this way.
162 For example:
163 video_nr=-1,2,-1 would assign minor number 2 to the second
164 recognized camera and use auto for the first one and for every
165 other camera.
166Default: -1
167-------------------------------------------------------------------------------
168Name: force_munmap;
169Type: bool array (min = 0, max = 64)
170Syntax: <0|1[,...]>
171Description: Force the application to unmap previously mapped buffer memory
172 before calling any VIDIOC_S_CROP or VIDIOC_S_FMT ioctl's. Not
173 all the applications support this feature. This parameter is
174 specific for each detected camera.
175 0 = do not force memory unmapping"
176 1 = force memory unmapping (save memory)"
177Default: 0
178-------------------------------------------------------------------------------
179Name: debug
180Type: int
181Syntax: <n>
182Description: Debugging information level, from 0 to 3:
183 0 = none (use carefully)
184 1 = critical errors
185 2 = significant informations
186 3 = more verbose messages
187 Level 3 is useful for testing only, when only one device
188 is used. It also shows some more informations about the
189 hardware being detected. This parameter can be changed at
190 runtime thanks to the /sys filesystem.
191Default: 2
192-------------------------------------------------------------------------------
193
194
1958. Optional device control through "sysfs" [1]
196==========================================
197It is possible to read and write both the SN9C10x and the image sensor
198registers by using the "sysfs" filesystem interface.
199
200Every time a supported device is recognized, a write-only file named "green" is
201created in the /sys/class/video4linux/videoX directory. You can set the green
202channel's gain by writing the desired value to it. The value may range from 0
203to 15 for SN9C101 or SN9C102 bridges, from 0 to 127 for SN9C103 bridges.
204Similarly, only for SN9C103 controllers, blue and red gain control files are
205available in the same directory, for which accepted values may range from 0 to
206127.
207
208There are other four entries in the directory above for each registered camera:
209"reg", "val", "i2c_reg" and "i2c_val". The first two files control the
210SN9C10x bridge, while the other two control the sensor chip. "reg" and
211"i2c_reg" hold the values of the current register index where the following
212reading/writing operations are addressed at through "val" and "i2c_val". Their
213use is not intended for end-users. Note that "i2c_reg" and "i2c_val" will not
214be created if the sensor does not actually support the standard I2C protocol or
215its registers are not 8-bit long. Also, remember that you must be logged in as
216root before writing to them.
217
218As an example, suppose we were to want to read the value contained in the
219register number 1 of the sensor register table - which is usually the product
220identifier - of the camera registered as "/dev/video0":
221
222 [root@localhost #] cd /sys/class/video4linux/video0
223 [root@localhost #] echo 1 > i2c_reg
224 [root@localhost #] cat i2c_val
225
226Note that "cat" will fail if sensor registers cannot be read.
227
228Now let's set the green gain's register of the SN9C101 or SN9C102 chips to 2:
229
230 [root@localhost #] echo 0x11 > reg
231 [root@localhost #] echo 2 > val
232
233Note that the SN9C10x always returns 0 when some of its registers are read.
234To avoid race conditions, all the I/O accesses to the above files are
235serialized.
236
237The sysfs interface also provides the "frame_header" entry, which exports the
238frame header of the most recent requested and captured video frame. The header
239is 12-bytes long and is appended to every video frame by the SN9C10x
240controllers. As an example, this additional information can be used by the user
241application for implementing auto-exposure features via software.
242
243The following table describes the frame header:
244
245Byte # Value Description
246------ ----- -----------
2470x00 0xFF Frame synchronisation pattern.
2480x01 0xFF Frame synchronisation pattern.
2490x02 0x00 Frame synchronisation pattern.
2500x03 0xC4 Frame synchronisation pattern.
2510x04 0xC4 Frame synchronisation pattern.
2520x05 0x96 Frame synchronisation pattern.
2530x06 0x00 or 0x01 Unknown meaning. The exact value depends on the chip.
2540x07 0xXX Variable value, whose bits are ff00uzzc, where ff is a
255 frame counter, u is unknown, zz is a size indicator
256 (00 = VGA, 01 = SIF, 10 = QSIF) and c stands for
257 "compression enabled" (1 = yes, 0 = no).
2580x08 0xXX Brightness sum inside Auto-Exposure area (low-byte).
2590x09 0xXX Brightness sum inside Auto-Exposure area (high-byte).
260 For a pure white image, this number will be equal to 500
261 times the area of the specified AE area. For images
262 that are not pure white, the value scales down according
263 to relative whiteness.
2640x0A 0xXX Brightness sum outside Auto-Exposure area (low-byte).
2650x0B 0xXX Brightness sum outside Auto-Exposure area (high-byte).
266 For a pure white image, this number will be equal to 125
267 times the area outside of the specified AE area. For
268 images that are not pure white, the value scales down
269 according to relative whiteness.
270
271The AE area (sx, sy, ex, ey) in the active window can be set by programming the
272registers 0x1c, 0x1d, 0x1e and 0x1f of the SN9C10x controllers, where one unit
273corresponds to 32 pixels.
274
275[1] The frame header has been documented by Bertrik Sikken.
276
277
2789. Supported devices
279====================
280None of the names of the companies as well as their products will be mentioned
281here. They have never collaborated with the author, so no advertising.
282
283From the point of view of a driver, what unambiguously identify a device are
284its vendor and product USB identifiers. Below is a list of known identifiers of
285devices mounting the SN9C10x PC camera controllers:
286
287Vendor ID Product ID
288--------- ----------
2890x0c45 0x6001
2900x0c45 0x6005
2910x0c45 0x6009
2920x0c45 0x600d
2930x0c45 0x6024
2940x0c45 0x6025
2950x0c45 0x6028
2960x0c45 0x6029
2970x0c45 0x602a
2980x0c45 0x602b
2990x0c45 0x602c
3000x0c45 0x6030
3010x0c45 0x6080
3020x0c45 0x6082
3030x0c45 0x6083
3040x0c45 0x6088
3050x0c45 0x608a
3060x0c45 0x608b
3070x0c45 0x608c
3080x0c45 0x608e
3090x0c45 0x608f
3100x0c45 0x60a0
3110x0c45 0x60a2
3120x0c45 0x60a3
3130x0c45 0x60a8
3140x0c45 0x60aa
3150x0c45 0x60ab
3160x0c45 0x60ac
3170x0c45 0x60ae
3180x0c45 0x60af
3190x0c45 0x60b0
3200x0c45 0x60b2
3210x0c45 0x60b3
3220x0c45 0x60b8
3230x0c45 0x60ba
3240x0c45 0x60bb
3250x0c45 0x60bc
3260x0c45 0x60be
327
328The list above does not imply that all those devices work with this driver: up
329until now only the ones that mount the following image sensors are supported;
330kernel messages will always tell you whether this is the case:
331
332Model Manufacturer
333----- ------------
334HV7131D Hynix Semiconductor, Inc.
335MI-0343 Micron Technology, Inc.
336PAS106B PixArt Imaging, Inc.
337PAS202BCB PixArt Imaging, Inc.
338TAS5110C1B Taiwan Advanced Sensor Corporation
339TAS5130D1B Taiwan Advanced Sensor Corporation
340
341All the available control settings of each image sensor are supported through
342the V4L2 interface.
343
344Donations of new models for further testing and support would be much
345appreciated. Non-available hardware will not be supported by the author of this
346driver.
347
348
34910. How to add plug-in's for new image sensors
350==============================================
351It should be easy to write plug-in's for new sensors by using the small API
352that has been created for this purpose, which is present in "sn9c102_sensor.h"
353(documentation is included there). As an example, have a look at the code in
354"sn9c102_pas106b.c", which uses the mentioned interface.
355
356At the moment, possible unsupported image sensors are: CIS-VF10 (VGA),
357OV7620 (VGA), OV7630 (VGA).
358
359
36011. Notes for V4L2 application developers
361=========================================
362This driver follows the V4L2 API specifications. In particular, it enforces two
363rules:
364
365- exactly one I/O method, either "mmap" or "read", is associated with each
366file descriptor. Once it is selected, the application must close and reopen the
367device to switch to the other I/O method;
368
369- although it is not mandatory, previously mapped buffer memory should always
370be unmapped before calling any "VIDIOC_S_CROP" or "VIDIOC_S_FMT" ioctl's.
371The same number of buffers as before will be allocated again to match the size
372of the new video frames, so you have to map the buffers again before any I/O
373attempts on them.
374
375Consistently with the hardware limits, this driver also supports image
376downscaling with arbitrary scaling factors from 1, 2 and 4 in both directions.
377However, the V4L2 API specifications don't correctly define how the scaling
378factor can be chosen arbitrarily by the "negotiation" of the "source" and
379"target" rectangles. To work around this flaw, we have added the convention
380that, during the negotiation, whenever the "VIDIOC_S_CROP" ioctl is issued, the
381scaling factor is restored to 1.
382
383This driver supports two different video formats: the first one is the "8-bit
384Sequential Bayer" format and can be used to obtain uncompressed video data
385from the device through the current I/O method, while the second one provides
386"raw" compressed video data (without frame headers not related to the
387compressed data). The compression quality may vary from 0 to 1 and can be
388selected or queried thanks to the VIDIOC_S_JPEGCOMP and VIDIOC_G_JPEGCOMP V4L2
389ioctl's. For maximum flexibility, both the default active video format and the
390default compression quality depend on how the image sensor being used is
391initialized (as described in the documentation of the API for the image sensors
392supplied by this driver).
393
394
39512. Video frame formats [1]
396=======================
397The SN9C10x PC Camera Controllers can send images in two possible video
398formats over the USB: either native "Sequential RGB Bayer" or Huffman
399compressed. The latter is used to achieve high frame rates. The current video
400format may be selected or queried from the user application by calling the
401VIDIOC_S_FMT or VIDIOC_G_FMT ioctl's, as described in the V4L2 API
402specifications.
403
404The name "Sequential Bayer" indicates the organization of the red, green and
405blue pixels in one video frame. Each pixel is associated with a 8-bit long
406value and is disposed in memory according to the pattern shown below:
407
408B[0] G[1] B[2] G[3] ... B[m-2] G[m-1]
409G[m] R[m+1] G[m+2] R[m+2] ... G[2m-2] R[2m-1]
410...
411... B[(n-1)(m-2)] G[(n-1)(m-1)]
412... G[n(m-2)] R[n(m-1)]
413
414The above matrix also represents the sequential or progressive read-out mode of
415the (n, m) Bayer color filter array used in many CCD/CMOS image sensors.
416
417One compressed video frame consists of a bitstream that encodes for every R, G,
418or B pixel the difference between the value of the pixel itself and some
419reference pixel value. Pixels are organised in the Bayer pattern and the Bayer
420sub-pixels are tracked individually and alternatingly. For example, in the
421first line values for the B and G1 pixels are alternatingly encoded, while in
422the second line values for the G2 and R pixels are alternatingly encoded.
423
424The pixel reference value is calculated as follows:
425- the 4 top left pixels are encoded in raw uncompressed 8-bit format;
426- the value in the top two rows is the value of the pixel left of the current
427 pixel;
428- the value in the left column is the value of the pixel above the current
429 pixel;
430- for all other pixels, the reference value is the average of the value of the
431 pixel on the left and the value of the pixel above the current pixel;
432- there is one code in the bitstream that specifies the value of a pixel
433 directly (in 4-bit resolution);
434- pixel values need to be clamped inside the range [0..255] for proper
435 decoding.
436
437The algorithm purely describes the conversion from compressed Bayer code used
438in the SN9C10x chips to uncompressed Bayer. Additional steps are required to
439convert this to a color image (i.e. a color interpolation algorithm).
440
441The following Huffman codes have been found:
4420: +0 (relative to reference pixel value)
443100: +4
444101: -4?
4451110xxxx: set absolute value to xxxx.0000
4461101: +11
4471111: -11
44811001: +20
449110000: -20
450110001: ??? - these codes are apparently not used
451
452[1] The Huffman compression algorithm has been reverse-engineered and
453 documented by Bertrik Sikken.
454
455
45613. Contact information
457=======================
458The author may be contacted by e-mail at <luca.risolia@studio.unibo.it>.
459
460GPG/PGP encrypted e-mail's are accepted. The GPG key ID of the author is
461'FCE635A4'; the public 1024-bit key should be available at any keyserver;
462the fingerprint is: '88E8 F32F 7244 68BA 3958 5D40 99DA 5D2A FCE6 35A4'.
463
464
46514. Credits
466===========
467Many thanks to following persons for their contribute (listed in alphabetical
468order):
469
470- Luca Capello for the donation of a webcam;
471- Joao Rodrigo Fuzaro, Joao Limirio, Claudio Filho and Caio Begotti for the
472 donation of a webcam;
473- Carlos Eduardo Medaglia Dyonisio, who added the support for the PAS202BCB
474 image sensor;
475- Stefano Mozzi, who donated 45 EU;
476- Bertrik Sikken, who reverse-engineered and documented the Huffman compression
477 algorithm used in the SN9C10x controllers and implemented the first decoder;
478- Mizuno Takafumi for the donation of a webcam;
479- An "anonymous" donator (who didn't want his name to be revealed) for the
480 donation of a webcam.