I can also confirm, this is still an issue in 1.20.4. I managed to (mostly) fix the issue with a custom Fabric mod as a workaround for the time being.
The mod I created which fixes this bug can be found on Curseforge and Modrinth.
Currently my fix is part of a larger mod I'm working on, but I might move it to a stand-alone mod. Either way, it is not released/published yet.
MC-108942
TheSquire
I can also confirm, this is still an issue in 1.20.4. I managed to (mostly) fix the issue with a custom Fabric mod as a workaround for the time being.
The mod I created which fixes this bug can be found on Curseforge and Modrinth.