XNA is .net compliment and therefore can really be developed in any .net language however, C# is the language used in XNA Game Studio Express. There are numerous tutorials for using other .net languages though (specifically vb.net as a alternative)
If you want to (or prefer to use) vb.net, just add the references.