The thing I found most disturbing about this question was the fact that your life partner doesn't respect you enough to respect your beliefs and your right to practice your spirituality.
Until there are some ground rules set, an understanding achieved, and some mutual respect in this relationship, there will be friction and discord if you practice your religion openly.
In the meantime-- a few inconspicuous ways to practice your craft could be:
1) candle magick, how could anyone object to a few pretty candles burning-- this person wouldn't have to be told the meaning and purpose behind these candles.
2) When you cleanse your home, use a little green magick-- sprinkle herbs for magickal cleansing in the water you're using to mop the floors.
3) Take a cleansing bath-- light some white candles, toss a pinch of sea salt and a sprig of rosemary or lavender in your water.
I really do wish you the best of luck...and I will be thinking about you.