使用video4linux将mjpeg转换为原始rgb24

mjpeg to raw rgb24 with video4linux

本文关键字:原始 rgb24 转换 mjpeg video4linux 使用      更新时间:2023-10-16

我正在使用video4linux编写一个c++网络摄像头查看器。我需要一个RGB24输出(交错R8B8G8)用于显示。我可以获得几乎所有低分辨率网络摄像头的视频输入,使用YUYV、GREY8或RGB24。但我也需要从高分辨率网络摄像头获得输入,当需要高帧率时,它们使用MJPEG进行压缩。

我可以使用V4L2_PIX_FMT_MJPEG作为像素格式获得MJPEG流,但收到的帧缓冲区是压缩的。

如何快速将其转换为RGB24

我可以使用libjpeg吗

我找到的最快的解决方案是mjpegtools的decode_jpeg_raw,它将jpeg数据解码为平面YUV420。然后通过以下函数完成从yuv420到rgb24的转换:

inline int clip(int value) {
    return (value > 255) ? 255 : (value < 0) ? 0 : value;
}
static void yuv420_to_rgb24(
/* luminance (source) */const uint8_t* const y
/* u chrominance (source) */, const uint8_t* u
/* v chrominance (source) */, const uint8_t* v
/* rgb interleaved (destination) */, uint8_t* const dst
/* jpeg size */, int const size
/* image width */, int const width) {
    const int lineSize = width * 3;
    uint8_t* r1 = dst;
    uint8_t* g1 = r1 + 1;
    uint8_t* b1 = r1 + 2;
    uint8_t* r2 = r1 + lineSize;
    uint8_t* g2 = r2 + 1;
    uint8_t* b2 = r2 + 2;
    const uint8_t* y1 = y;
    const uint8_t* y2 = y + width;
    uint8_t* const end = r1 + size;
    int c1 = 0;
    int c2 = 0;
    int e = 0;
    int d = 0;
    while (r1 != end) {
        uint8_t* const lineEnd = r2;
        /* line by line */
        while (r1 != lineEnd) {
            /* first pixel */
            c1 = *y1 - 16;
            c2 = *y2 - 16;
            d = *u - 128;
            e = *v - 128;
            *r1 = clip(c1 + ((454 * e) >> 8));
            *g1 = clip(c1 - ((88 * e + 183 * d) >> 8));
            *b1 = clip(c1 + ((359 * d) >> 8));
            *r2 = clip(c2 + ((454 * e) >> 8));
            *g2 = clip(c2 - ((88 * e + 183 * d) >> 8));
            *b2 = clip(c2 + ((359 * d) >> 8));
            r1 += 3;
            g1 += 3;
            b1 += 3;
            r2 += 3;
            g2 += 3;
            b2 += 3;
            ++y1;
            ++y2;
            /* second pixel */
            c1 = *y1 - 16;
            c2 = *y2 - 16;
            d = *u - 128;
            e = *v - 128;
            *r1 = clip(c1 + ((454 * e) >> 8));
            *g1 = clip(c1 - ((88 * e + 183 * d) >> 8));
            *b1 = clip(c1 + ((359 * d) >> 8));
            *r2 = clip(c2 + ((454 * e) >> 8));
            *g2 = clip(c2 - ((88 * e + 183 * d) >> 8));
            *b2 = clip(c2 + ((359 * d) >> 8));
            r1 += 3;
            g1 += 3;
            b1 += 3;
            r2 += 3;
            g2 += 3;
            b2 += 3;
            ++y1;
            ++y2;
            ++u;
            ++v;
        }
        r1 += lineSize;
        g1 += lineSize;
        b1 += lineSize;
        r2 += lineSize;
        g2 += lineSize;
        b2 += lineSize;
        y1 += width;
        y2 += width;
    }
}

是的,您可以使用libjpeg,但通常libjpeg的输出是YUV420或YUV422。您可以使用该代码:http://mxhaard.free.fr/spca50x/Download/gspcav1-20071224.tar.gz(检查解码器源代码,有一个小型jpeg解码器运行良好,可以直接处理颜色转换,因此输出在RGB888中)