Skip to content

DO NOT MERGE: set default OPTIM to 3 in Makefile

Archit Tamarapurequested to merge
add-O3-to-Makefile into main

See #2263, for testing BE only.

Results

-O3

Pipeline link

Failed testcases:

test_param_file.py 
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-stereo at 13.2 kbps, 32kHz in, 32kHz out, DTX on, random FER at 5%, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 289 - MLD: 0.36370206 > 0.0 - Channel 1 SSNR: 93.24 - Channel 2 SSNR: 94.03 -  - Channel 0 ODG: 0.168 - Channel 1 ODG: 0.165)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-stereo at 32 kbps, 48kHz in, 48kHz out, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 15 - MLD: 0.07339431 > 0.0 - Channel 1 SSNR: 97.45 - Channel 2 SSNR: 99.55 -  - Channel 0 ODG: 0.179 - Channel 1 ODG: 0.178)
check-be-to-target-short-enc-0db 
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[basop_encoder-stereo at 32 kbps, 48kHz in, 48kHz out, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 16)
check-be-to-target-short-enc-+10db 
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[basop_encoder-stereo at 32 kbps, 48kHz in, 48kHz out, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 29)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[basop_encoder-stereo at 32 kbps, 48kHz in, 48kHz out, DTX on, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 275)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[basop_encoder-MASA 1dir 2TC at 13.2 kbps, 48kHz in, 48kHz out, EXT out, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 207)
check-be-to-target-short-enc--10db 
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[basop_encoder-MASA 1dir 2TC at 13.2 kbps, 48kHz in, 48kHz out, EXT out, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 6)

-O2

Pipeline link

Failed testcases:

test_param_file.py 
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-stereo at 13.2 kbps, 32kHz in, 32kHz out, DTX on, random FER at 5%, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 289 - MLD: 0.36370206 > 0.0 - Channel 1 SSNR: 93.24 - Channel 2 SSNR: 94.03 -  - Channel 0 ODG: 0.168 - Channel 1 ODG: 0.165)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-stereo at 32 kbps, 48kHz in, 48kHz out, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 15 - MLD: 0.07339431 > 0.0 - Channel 1 SSNR: 97.45 - Channel 2 SSNR: 99.55 -  - Channel 0 ODG: 0.179 - Channel 1 ODG: 0.178)
check-be-to-target-short-enc-0db 
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[basop_encoder-stereo at 32 kbps, 48kHz in, 48kHz out, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 16)
check-be-to-target-short-enc-+10db 
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[basop_encoder-stereo at 32 kbps, 48kHz in, 48kHz out, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 29)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[basop_encoder-stereo at 32 kbps, 48kHz in, 48kHz out, DTX on, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 275)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[basop_encoder-MASA 1dir 2TC at 13.2 kbps, 48kHz in, 48kHz out, EXT out, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 207)
check-be-to-target-short-enc--10db 
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[basop_encoder-MASA 1dir 2TC at 13.2 kbps, 48kHz in, 48kHz out, EXT out, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 6)

-O1

Pipeline link

Failed testcases:

test_param_file.py 
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-stereo at 13.2 kbps, 32kHz in, 32kHz out, DTX on, random FER at 5%, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 289 - MLD: 0.36370206 > 0.0 - Channel 1 SSNR: 93.24 - Channel 2 SSNR: 94.03 -  - Channel 0 ODG: 0.168 - Channel 1 ODG: 0.165)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[stv-stereo at 32 kbps, 48kHz in, 48kHz out, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 15 - MLD: 0.07339431 > 0.0 - Channel 1 SSNR: 97.45 - Channel 2 SSNR: 99.55 -  - Channel 0 ODG: 0.179 - Channel 1 ODG: 0.178)
check-be-to-target-short-enc-0db 
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[basop_encoder-stereo at 32 kbps, 48kHz in, 48kHz out, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 16)
check-be-to-target-short-enc-+10db 
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[basop_encoder-stereo at 32 kbps, 48kHz in, 48kHz out, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 29)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[basop_encoder-stereo at 32 kbps, 48kHz in, 48kHz out, DTX on, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 275)
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[basop_encoder-MASA 1dir 2TC at 13.2 kbps, 48kHz in, 48kHz out, EXT out, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 207)
check-be-to-target-short-enc--10db 
FAILED tests/codec_be_on_mr_nonselection/test_param_file.py::test_param_file_tests[basop_encoder-MASA 1dir 2TC at 13.2 kbps, 48kHz in, 48kHz out, EXT out, bandwidth switching] - Failed: Difference between ref and dut in output only (Non-BE - MAX_ABS_DIFF: 6)
Edited by Archit Tamarapu

Merge request reports