What are some examples of non-creature permanents?
A permanent is anything on the battlefield (a.k.a. "in play"),CR 110 whether represented by a card or a token. A noncreature permanent is any permanent that is not a creature.

For example, Icy Manipulator, when on the battlefield, would be a noncreature permanent. A land like a Forest, when on the battlefield, would also be a noncreature permanent. Treasure tokens, if you've seen those, would also be noncreature permanents.

More precisely, permanents can have any of five types: land, creature, artifact, enchantment, and planeswalker.CR 110.4 A single permanent usually has one of these types, but it can have more than one (for example, Juggernaut), and some permanents can even gain or lose types due to things happening in the game (for example, vehicles like Fleetwheel Cruiser). The only thing that matters for deciding whether something is a "noncreature permanent" is, at the moment you need to make the decision, whether it is a permanent and whether it has the type "creature". If it has other types as well, that doesn't matter. If it became a creature in the past or is going to stop being a creature in the future, that doesn't matter for deciding whether it's a noncreature permanent right now.

Note that cards which represent permanents when they're on the battlefield do not represent permanents while they're in your hand, in the graveyard, in your library, or anywhere else other than the battlefield.CR 110.1 Anywhere else, they're just cards. (There's a rarely used term, "permanent card", which means a card that isn't on the battlefield but would be a permanent if it were.)