Users with higher reputation power that give you rep will raise it. By how much depends on what their reputation power is. Normal users with only 10 rep (base) will not raise your reputation level, or if they do it will be by a very small fraction. If their reputation icon is grey, it means you gained no reputation increase from it. If green, it means your reputation went up.