Palette C++ library

v1.0.0

Table of contents

• Overview
• Versions
• Library files
• Palette class description
  • Palette class declaration
  • getVersion method
  • initVFilter method
  • setParam method
  • getParam method
  • getParams method
  • executeCommand method
  • processFrame method
  • setMask method
  • encodeSetParamCommand method of VFilter class
  • encodeCommand method of VFilter class
  • decodeCommand method of VFilter class
  • decodeAndExecuteCommand method
• Data structures
  • VFilterCommand enum
  • VFilterParam enum
• VFilterParams class description
  • VFilterParams class declaration
  • Serialize VFilter params
  • Deserialize VFilter params
  • Read params from JSON file and write to JSON file
• Build and connect to your project
• Example

Overview

Palette C++ library implements different color palettes for thermal cameras: Inverse (Greyscale inversion), Ironbow, Rainbow and Arctic. The library depends on VFilter library (provides interface for video filter, source code included, Apache 2.0 license). The library doesn’t have third-party dependencies to be installed in OS. Additionally test application depends on OpenCV library (version >= 4.5, linked, Apache 2.0 license) to provide user interface. The library uses C++17 standard. Example of implemented palettes:

SOURCE	INVERSE
ARCTIC	IRONBOW
RAINBOW

Versions

Table 1 - Library versions.

Version	Release date	What’s new
1.0.0	01.10.2024	First version of the library.

Library files

The library supplied by source code only. The user would be given a set of files in the form of a CMake project (repository). The repository structure is shown below:

CMakeLists.txt ----------- Main CMake file of the library.
3rdparty ----------------- Folder with third-party libraries.
    CMakeLists.txt ------- CMake file which include third-party libraries.
    VFilter -------------- Folder with VFilter library source code.
src ---------------------- Folder with source code of the library.
    CMakeLists.txt ------- CMake file of the library.
    Palette.cpp ---------- C++ implementation file.
    Palette.h ------------ Header file which includes Palette class declaration.
    PaletteVersion.h ----- Header file which includes version of the library.
    PaletteVersion.h.in -- CMake service file to generate version file.
test --------------------- Folder for test application.
    CMakeLists.txt ------- CMake file for test application.
    main.cpp ------------- Source code file of the test application.

Palette class description

Palette class declaration

The Palette class declared in Palette.h file. Class declaration:

namespace cr
{
namespace video
{
class Palette : public VFilter
{
public:

    /// Get the version of the Palette class.
    static std::string getVersion();

    /// Initialize palette filter.
    bool initVFilter(VFilterParams& params) override;

    /// Set palette filter parameter.
    bool setParam(VFilterParam id, float value) override;

    /// Get the value of a specific palette filter parameter.
    float getParam(VFilterParam id) override;

    /// Get the structure containing all palette filter.
    void getParams(VFilterParams& params) override;

    /// Execute a palette filter action command.
    bool executeCommand(VFilterCommand id) override;

    /// Process frame (Perform palette filter).
    bool processFrame(cr::video::Frame& frame) override;

    /// Set mask for filter. Not supported by palette filter.
    bool setMask(cr::video::Frame mask) override;

    /// Decode and execute command.
    bool decodeAndExecuteCommand(uint8_t* data, int size) override;
};
}
}

getVersion method

The getVersion() static method returns string of current class version. Method declaration:

static std::string getVersion();

Method can be used without Palette class instance:

std::cout << "Palette version: " << cr::video::Palette::getVersion();

Console output:

Palette version: 1.0.0

initVFilter method

The initVFilter(…) method initializes palette filter. Method uses only parameters: mode and type from VFilterParams class. All other params will be ignored. Method declaration:

bool initVFilter(VFilterParams& params) override;

Parameter	Value
params	VFilterParams class object. Method uses only parameters: mode and type fields of VFilterParams class.

Returns: TRUE if the video filter initialized or FALSE if not.

setParam method

The setParam (…) method sets new parameters value. The library provides thread-safe setParam(…) method call. This means that the setParam(…) method can be safely called from any thread. Method declaration:

bool setParam(VFilterParam id, float value) override;

Parameter	Description
id	Parameter ID according to VFilterParam enum. Method supports only parameters: MODE and TYPE. Other parameters will not be set.
value	Parameter value. Value depends on parameter ID.

Returns: TRUE if the parameter was set or FALSE if not (not supported).

getParam method

The getParam(…) method returns parameter value. The library provides thread-safe getParam(…) method call. This means that the getParam(…) method can be safely called from any thread. Method declaration:

float getParam(VFilterParam id) override;

Parameter	Description
id	Parameter ID according to VFilterParam enum. Method supports only parameters: MODE, TYPE and PROCESSING_TIME_MCSEC. For other parameters the method will return -1.

Returns: parameter value or -1 if the parameters doesn’t exist.

getParams method

The getParams(…) method is designed to obtain all palette filter params. The library provides thread-safe getParams(…) method call. This means that the getParams(…) method can be safely called from any thread. Method declaration:

void getParams(VFilterParams& params) override;

Parameter	Description
params	Reference to VFilterParams object to store params. Method will fill parameters: mode, processingTimeMcSec and type. Other parameters will be set to -1.0.

executeCommand method

The executeCommand(…) method executes video filter (palette filter) action command. The library provides thread-safe executeCommand(…) method call. This means that the executeCommand(…) method can be safely called from any thread. Method declaration:

bool executeCommand(VFilterCommand id) override;

Parameter	Description
id	Command ID according to VFilterCommand enum. Method supports only ON and OFF commands.

Returns: TRUE if the command executed or FALSE if not.

processFrame method

The processFrame(…) method designed to process frame (palette filter). The method accepts only YUV pixel format (Fourcc::YUV24). The library provides thread-safe processFrame(…) method call. This means that the processFrame(…) method can be safely called from any thread. Method declaration:

bool processFrame(cr::video::Frame& frame) override;

Parameter	Description
frame	Reference to Frame object. The method accepts only YUV pixel format (Fourcc::YUV24).

Returns: TRUE if frame processed (palette filter) or FALSE if not. If filter disabled the method will return TRUE without video frame processing.

setMask method

The setMask(…) method designed to set video filter mask. Mask not supported by Palette class. Method declaration:

bool setMask(cr::video::Frame mask) override;

Parameter	Description
mask	Filter mask is Frame object with GRAY pixel format. Mask not supported by Palette class.

Returns: TRUE in any cases.

encodeSetParamCommand method of VFilter class

The encodeSetParamCommand(…) static method encodes command to change any VFilter parameter value remote. To control any video filter remotely, the developer has to design his own protocol and according to it encode the command and deliver it over the communication channel. To simplify this, the VFilter class contains static methods for encoding the control command. The VFilter class provides two types of commands: a parameter change command (SET_PARAM) and an action command (COMMAND). encodeSetParamCommand(…) designed to encode SET_PARAM command. Method declaration:

static void encodeSetParamCommand(uint8_t* data, int& size, VFilterParam id, float value);

Parameter	Description
data	Pointer to data buffer for encoded command. Must have size >= 11.
size	Size of encoded data. Size will be 11 bytes.
id	Parameter ID according to VFilterParam enum.
value	Parameter value.

encodeSetParamCommand(…) is static and can be used without VFilter class instance. This method used on client side (control system). Command encoding example:

// Buffer for encoded data.
uint8_t data[11];
// Size of encoded data.
int size = 0;
// Encode command.
VFilter::encodeSetParamCommand(data, size, VFilterParam::TYPE, 2);

encodeCommand method of VFilter class

The encodeCommand(…) static method encodes action command for VFilter remote control. To control any video filter remotely, the developer has to design his own protocol and according to it encode the command and deliver it over the communication channel. To simplify this, the VFilter class contains static methods for encoding the control command. The VFilter class provides two types of commands: a parameter change command (SET_PARAM) and an action command (COMMAND). encodeCommand(…) designed to encode COMMAND (action command). Method declaration:

static void encodeCommand(uint8_t* data, int& size, VFilterCommand id);

Parameter	Description
data	Pointer to data buffer for encoded command. Must have size >= 7.
size	Size of encoded data. Size will be 7 bytes.
id	Command ID according to VFilterCommand enum.

encodeCommand(…) is static and can be used without VFilter class instance. This method used on client side (control system). Command encoding example:

// Buffer for encoded data.
uint8_t data[7];
// Size of encoded data.
int size = 0;
// Encode command.
VFilter::encodeCommand(data, size, VFilterCommand::RESTART);

decodeCommand method of VFilter class

The decodeCommand(…) static method decodes command on video filter side (on edge device). Method declaration:

static int decodeCommand(uint8_t* data, int size, VFilterParam& paramId, VFilterCommand& commandId, float& value);

Parameter	Description
data	Pointer to input command.
size	Size of command. Must be 11 bytes for SET_PARAM and 7 bytes for COMMAND (action command).
paramId	VFilter parameter ID according to VFilterParam enum. After decoding SET_PARAM command the method will return parameter ID.
commandId	VFilter command ID according to VFilterCommand enum. After decoding COMMAND the method will return command ID.
value	VFilter parameter value (after decoding SET_PARAM command).

Returns: 0 - in case decoding COMMAND (action command), 1 - in case decoding SET_PARAM command or -1 in case errors.

decodeAndExecuteCommand method

The decodeAndExecuteCommand(…) method decodes and executes command encoded by encodeSetParamCommand(…) and encodeCommand(…) methods on video filter side. The library provides thread-safe decodeAndExecuteCommand(…) method call. This means that the decodeAndExecuteCommand(…) method can be safely called from any thread. Method declaration:

bool decodeAndExecuteCommand(uint8_t* data, int size) override;

Parameter	Description
data	Pointer to input command.
size	Size of command. Must be 11 bytes for SET_PARAM or 7 bytes for COMMAND.

Returns: TRUE if command decoded (SET_PARAM or COMMAND) and executed (action command or set param command).

Data structures

VFilterCommand enum

Enum declaration:

enum class VFilterCommand
{
    /// Reset image filter algorithm.
    RESET = 1,
    /// Enable filter.
    ON,
    /// Disable filter.
    OFF
};

Table 2 - Action commands description.

Command	Description
RESET	Not supported by Palette class.
ON	Enable palette filter.
OFF	Disable palette filter.

VFilterParam enum

Enum declaration:

enum class VFilterParam
{
	/// Current filter mode, usually 0 - off, 1 - on.
	MODE = 1,
	/// Enhancement level for particular filter, as a percentage in range from 
	/// 0% to 100%.
	LEVEL,
	/// Processing time in microseconds. Read only parameter.
	PROCESSING_TIME_MCSEC,
	/// Type of the filter. Depends on the implementation.
	TYPE,
	/// VFilter custom parameter. Custom parameters used when particular image 
	/// filter has specific unusual parameter.
	CUSTOM_1,
	/// VFilter custom parameter. Custom parameters used when particular image 
	/// filter has specific unusual parameter.
	CUSTOM_2,
	/// VFilter custom parameter. Custom parameters used when particular image 
	/// filter has specific unusual parameter.
	CUSTOM_3
};

Table 3 - Params description.

Parameter	Access	Description
MODE	read / write	Filter mode: 0 - disabled, 1 - enabled.
LEVEL	read / write	Not supported by Palette class.
PROCESSING_TIME_MCSEC	read only	Processing time in microseconds. Read only parameter. Used to check performance of palette filter.
TYPE	read / write	Palette type: 0 - [DEFAULT] Inverse. 1 - Ironbow. 2 - Rainbow. 3 - Arctic.
CUSTOM_1	read / write	Not supported by Palette class.
CUSTOM_2	read / write	Not supported by Palette class.
CUSTOM_3	read / write	Not supported by Palette class.

VFilterParams class description

VFilterParams class declaration

The VFilterParams class is used to provide video filter parameters structure. Also VFilterParams provides possibility to write/read params from JSON files (JSON_READABLE macro) and provides methods to encode and decode params. VFilterParams interface class declared in VFilter.h file. Class declaration:

class VFilterParams
{
public:
    /// Current filter mode, usually 0 - off, 1 - on.
    int mode{ 0 };
    /// Enhancement level for particular filter, as a percentage in range from 
    /// 0% to 100%.
    float level{ 0 };
    /// Processing time in microseconds. Read only parameter.
    int processingTimeMcSec{ 0 };
    /// Type of the filter. Depends on the implementation.
    int type{ 0 };
    /// VFilter custom parameter. Custom parameters used when particular image 
    /// filter has specific unusual parameter.
    float custom1{ 0.0f };
    /// VFilter custom parameter. Custom parameters used when particular image 
    /// filter has specific unusual parameter.
    float custom2{ 0.0f };
    /// VFilter custom parameter. Custom parameters used when particular image 
    /// filter has specific unusual parameter.
    float custom3{ 0.0f };

    /// Macro from ConfigReader to make params readable/writable from JSON.
    JSON_READABLE(VFilterParams, mode, level, type, custom1, custom2, custom3)

    /// operator =
    VFilterParams& operator= (const VFilterParams& src);

    // Encode (serialize) params.
    bool encode(uint8_t* data, int bufferSize, int& size,
                                             VFilterParamsMask* mask = nullptr);
	// Decode (deserialize) params.
    bool decode(uint8_t* data, int dataSize);
};

Table 4 - VFilterParams class fields description is related to VFilterParam enum description.

Field	type	Description
mode	int	Palette mode: 0 - disabled, 1 - enabled.
level	float	Not supported by Palette class.
processingTimeMcSec	int	Processing time in microseconds. Read only parameter. Used to check performance of palette filter.
type	int	Palette type: 0 - [DEFAULT] Inverse. 1 - Ironbow. 2 - Rainbow. 3 - Arctic.
custom1	float	Not supported by Palette class.
custom2	float	Not supported by Palette class.
custom3	float	Not supported by Palette class.

None: VFilterParams class fields listed in Table 4 have to reflect params set/get by methods setParam(…) and getParam(…).

Serialize VFilter params

VFilterParams class provides method encode(…) to serialize VFilter params. Serialization of VFilterParams is necessary in case when video filter parameters have to be sent via communication channels. Method provides options to exclude particular parameters from serialization. To do this method inserts binary mask (1 byte) where each bit represents particular parameter and decode(…) method recognizes it. Method declaration:

bool encode(uint8_t* data, int bufferSize, int& size, VFilterParamsMask* mask = nullptr);

Parameter	Value
data	Pointer to data buffer. Buffer size must be >= 32 bytes.
bufferSize	Data buffer size. Buffer size must be >= 32 bytes.
size	Size of encoded data.
mask	Parameters mask - pointer to VFilterParamsMask structure. VFilterParamsMask (declared in VFilter.h file) determines flags for each field (parameter) declared in VFilterParams class. If user wants to exclude any parameters from serialization, he can put a pointer to the mask. If the user wants to exclude a particular parameter from serialization, he should set the corresponding flag in the VFilterParamsMask structure.

Returns: TRUE if params encoded (serialized) or FALSE if not (buffer size < 32).

VFilterParamsMask structure declaration:

struct VFilterParamsMask
{
    bool mode{ true };
    bool level{ true };
    bool processingTimeMcSec{ true };
    bool type{ true };
    bool custom1{ true };
    bool custom2{ true };
    bool custom3{ true };
};

Example without parameters mask:

// Prepare parameters.
cr::video::VFilterParams params;
params.level = 80.0f;

// Encode (serialize) params.
int bufferSize = 128;
uint8_t buffer[128];
int size = 0;
params.encode(buffer, bufferSize, size);

Example with parameters mask:

// Prepare parameters.
cr::video::VFilterParams params;
params.level = 80.0;

// Prepare mask.
cr::video::VFilterParams mask;
// Exclude level.
mask.level = false;

// Encode (serialize) params.
int bufferSize = 128;
uint8_t buffer[128];
int size = 0;
params1.encode(buffer, bufferSize, size, &mask);

Deserialize VFilter params

VFilterParams class provides method decode(…) to deserialize params. Deserialization of VFilterParams is necessary in case when it is needed to receive params via communication channels. Method automatically recognizes which parameters were serialized by encode(…) method. Method declaration:

bool decode(uint8_t* data, int dataSize);

Parameter	Value
data	Pointer to data buffer with serialized params.
dataSize	Size of command data.

Returns: TRUE if params decoded (deserialized) or FALSE if not.

Example:

// Prepare parameters.
cr::video::VFilterParams params1;
params1.level = 80;

// Encode (serialize) params.
int bufferSize = 128;
uint8_t buffer[128];
int size = 0;
params1.encode(buffer, bufferSize, size);

// Decode (deserialize) params.
cr::video::VFilterParams params2;
params2.decode(buffer, size);

Read params from JSON file and write to JSON file

VFilter depends on open source ConfigReader library which provides method to read params from JSON file and to write params to JSON file. Example of writing and reading params to JSON file:

// Prepare random params.
cr::video::VFilterParams params1;
params1.mode = 1;
params1.level = 10.1f;
params1.processingTimeMcSec = 10;
params1.type = 2;
params1.custom1 = 22.3;
params1.custom2 = 23.4;
params1.custom3 = 24.5;

// Save to JSON.
cr::utils::ConfigReader configReader1;
if (!configReader1.set(params1, "Params"))
    std::cout << "Can't set params" << std::endl;
if (!configReader1.writeToFile("VFilterParams.json"))
    std::cout << "Can't write to file" << std::endl;

// Read params from file.
cr::utils::ConfigReader configReader2;
if (!configReader2.readFromFile("VFilterParams.json"))
    std::cout << "Can't read from file" << std::endl;
cr::video::VFilterParams params2;
if (!configReader2.get(params2, "Params"))
    std::cout << "Can't get params" << std::endl;

VFilterParams.json will look like:

{
    "Params": {
        "custom1": 22.3,
        "custom2": 23.4,
        "custom3": 24.5,
        "level": 10.1,
        "mode": 1,
        "type": 2
    }
}

Build and connect to your project

Typical commands to build Palette:

cd Palette
mkdir build
cd build
cmake ..
make

If you want connect Palette to your CMake project as source code you can make follow. For example, if your repository has structure:

CMakeLists.txt
src
    CMakeList.txt
    yourLib.h
    yourLib.cpp

Create folder 3rdparty in your repository and copy Palette repository folder there. New structure of your repository:

CMakeLists.txt
src
    CMakeList.txt
    yourLib.h
    yourLib.cpp
3rdparty
    Palette

Create CMakeLists.txt file in 3rdparty folder. CMakeLists.txt should contain:

cmake_minimum_required(VERSION 3.13)

################################################################################
## 3RD-PARTY
## dependencies for the project
################################################################################
project(3rdparty LANGUAGES CXX)

################################################################################
## SETTINGS
## basic 3rd-party settings before use
################################################################################
# To inherit the top-level architecture when the project is used as a submodule.
SET(PARENT ${PARENT}_YOUR_PROJECT_3RDPARTY)
# Disable self-overwriting of parameters inside included subdirectories.
SET(${PARENT}_SUBMODULE_CACHE_OVERWRITE OFF CACHE BOOL "" FORCE)

################################################################################
## CONFIGURATION
## 3rd-party submodules configuration
################################################################################
SET(${PARENT}_SUBMODULE_PALETTE                         ON  CACHE BOOL "" FORCE)
if (${PARENT}_SUBMODULE_PALETTE)
    SET(${PARENT}_PALETTE                               ON  CACHE BOOL "" FORCE)
    SET(${PARENT}_PALETTE_TEST                          OFF CACHE BOOL "" FORCE)
endif()

################################################################################
## INCLUDING SUBDIRECTORIES
## Adding subdirectories according to the 3rd-party configuration
################################################################################
if (${PARENT}_SUBMODULE_PALETTE)
    add_subdirectory(Palette)
endif()

File 3rdparty/CMakeLists.txt adds folder Palette to your project and excludes test application from compiling (by default test application excluded from compiling if Palette included as sub-repository). Your repository new structure will be:

CMakeLists.txt
src
    CMakeList.txt
    yourLib.h
    yourLib.cpp
3rdparty
    CMakeLists.txt
    Palette

Next you need include folder 3rdparty in main CMakeLists.txt file of your repository. Add string at the end of your main CMakeLists.txt:

add_subdirectory(3rdparty)

Next you have to include Palette library in your src/CMakeLists.txt file:

target_link_libraries(${PROJECT_NAME} Palette)

Done!

Example

The example creates artificial image and provides user interface to control mode, level and type params:

#include <iostream>
#include <cstdint>
#include <string.h>
#include <opencv2/opencv.hpp>
#include "Palette.h"

using namespace cv;
using namespace std;
using namespace cr::video;

int main(void)
{
    std::cout << "Palette v" << Palette::getVersion() << std::endl;

	Mat srcImg = imread("test.png");
    if (srcImg.empty())
    {
        cout << "File test.png not found" << endl;
        return -1;
    }

    int width = srcImg.cols;
    int height = srcImg.rows;

    Palette palette;
    VFilterParams params;
    palette.setParam(VFilterParam::MODE, 1);
    bool saveFlag = false;

    // Main loop.
    while (true)
    {
		// Convert image to YUV24.
        Mat frameOpenCv;
        cvtColor(srcImg, frameOpenCv, COLOR_BGR2YUV);

        // Prepare frame.
        Frame frame(width, height, Fourcc::YUV24);
        memcpy(frame.data, frameOpenCv.data, width * height * 3);

        // Process frame.
        palette.processFrame(frame);

        // Get params.
        palette.getParams(params);

        // Convert to BGR24.
        cv::Mat resultFrame(frame.height, frame.width, CV_8UC3, frame.data);
        cvtColor(resultFrame, frameOpenCv, COLOR_YUV2BGR);

        // Name of palette.
        string palatteType;
        switch (params.type) {
        case 0: palatteType = "Inverse"; break;
        case 1: palatteType = "Ironbow"; break;
        case 2: palatteType = "Rainbow"; break;
        case 3: palatteType = "Arctic"; break;
        default: palatteType = "Inverse"; break; }

        // Show params.
        putText(frameOpenCv, "[button 1 to change] Palette: " + palatteType,
                cv::Point(5, 20), cv::FONT_HERSHEY_SIMPLEX, 0.5, cv::Scalar(255, 255, 0));
        putText(frameOpenCv, "[SPACE to change] Mode: " + string(params.mode == 1 ? "On" : "Off"),
                cv::Point(5, 40), cv::FONT_HERSHEY_SIMPLEX, 0.5, cv::Scalar(255, 255, 0));
        putText(frameOpenCv, "Processing time: " + to_string(params.processingTimeMcSec) + " usec",
                cv::Point(5, 60), cv::FONT_HERSHEY_SIMPLEX, 0.5, cv::Scalar(255, 255, 0));
        putText(frameOpenCv, "[ESC to exit]",
                cv::Point(5, 80), cv::FONT_HERSHEY_SIMPLEX, 0.5, cv::Scalar(255, 255, 0));

        // Show results.
        imshow("Palette", frameOpenCv);

		// Process keyboard events.
		switch (waitKey(30))
		{
		case 27:
            return 1;
        case 32:
            palette.setParam(VFilterParam::MODE, 1 - params.mode);
            break;
		case 49:
            params.type++;
            if (params.type > 3)
                params.type = 0;
            palette.setParam(VFilterParam::TYPE, params.type);
            break;
		}
    }
    return 1;
}

Example user interface: