Giving and taking space is truly a delicate balance, one you're struggling to maintain. You either want too much or too little and at your convenience. This isn't a one-way street: it involves two people. Open it up for discussion; hammer out the details.