It depends on the circumstances. If you didn't say no because you were legitimately scared for your life or safety, then it may be rape. Sometimes it isn't safe to resist, physically, or verbally: for example, when someone has a knife or gun to your head, or threatens you or your family if you say anything.