[Clipper]

For One-Shot Items, like Loaded Die, their status of being in use or turned sideways doesn't really matter. MunchkinMan often recommends to play them upright to indicate that you can use them, but many players turn them sideways to indicate they are not currently providing a bonus and don't need to be looked at to calculate your bonus.

Whichever way they are oriented, they can be used, provided you meet the conditions of playing them on the card.

So yes, you can start carrying your Loaded Die to avoid Charity. Your choice of orientation is up to you to decide. Personally, I go with the upright orientation, but I leave my one-shot Items in a different space on the table to my Persistent Items to distinguish them.