I've seen it commonly repeated the object oriented programming is based on modelling the real world, but is it?

Yes. The emphasis here is based on. OOP doesn't model the real world (if it does, then incidentally) and it is not supposed to. What OOP does is to allow us model programming problems the way we model the real world: as a system of entities that are defined through our abstraction of their behavior.