Just had a very weird conversation with someone discussing an open source voice assistant, I asked about its privacy and they blocked me. This isn't very reassuring.
Be really careful with voice assistants. As far as I know, all of them rely on sending your data to the manufacturer's server.
Open source alone won't protect you. Open source tells you what the software does, but if it does bad stuff you need to act on that information to protect yourself.