fix for 2268, to silence clang18, will add some complexity to the ifft

• Related issues: #2268
• Requested reviewers: @vaclav

Reason why this change is needed

• Fix USAN complaint.

Description of the change

• Ensure no pointer initialization outside buffer definition.

Affected operating points

• Should be bit-exact, will add some complexity to the ifft