Thanks, I used ed25519verify_bare and with your suggestions I was able to verify the signature correctly!
ed25519verify_bare