There are situations when a person wants to refuse, but considering it uncomfortable, impolite and disrespectful, he accepts an offer that he would like to refuse. There are people who simply cannot refuse. But the ability to say “no” in the right situation, so that the interlocutor is not offended, is a very useful skill.
There is no doubt that it is also wrong to say “no” to everyone. There may be a situation when you need help, and instead you receive a refusal. If people close to you asked you to look after the child, then you can’t refuse.
But it is a completely different matter when you are asked about something to which you have nothing to do. Just don't confuse it with selfishness. If strangers ask you for help, then you should not look for a benefit for yourself personally and refuse, and if there is none, then help within reason.
If you refuse, don't blame yourself. Why, then, there are two possible answers: "yes" and "no"? And then, so that the person himself chooses what he wants. You have the right to choose, because this is your life. Feelings of guilt manipulate a person like a doll on strings. Don't judge yourself for rejection. You can say no. Keep this in mind when you get rejected yourself.
Remember to be polite. Sometimes it's hard to say no to your face. If you can't firmly refuse, then politely refuse. Explain the reasons why you are refusing, even though you are not required to do so. Be understanding and apologize politely. Apologies should not be as if you owe something to the interlocutor or have done something wrong to him, but with a manifestation of regret and sincerity.
If the interlocutor does not understand that you are refusing him, then repeat your refusal. Perhaps your words sound uncertain. Refuse calmly and firmly, but without rudeness and insults. If a person asks you to do something that he is able to do himself, then feel free to refuse him. Say "no" and be prepared to be rejected sometimes.