There are several ways you can 'drop' your primary weapon.
1. Walk over another gun and press G to swap them therefore 'dropping' your current primary gun.
2. Wait to be killed and you will drop your gun!
And i believe there is no other method to 'drop' your primary gun.