Tab key bind for inventory doesnt close inventory

On certain map items, most, or even all of the map is greyed out when you stick it in an item frame or just hold it. Its not all maps, just some.