Imposter syndrome actually is real! Go and you might be better than you think! Playing with great musicians also really helps improve your own skills.
(I have had many similar thoughts and I've never regretted showing up. I hope these comments are welcome.)