There is a deep relation between Loop Quantum Gravity and notions from category theory, which have been pointed out by many researchers, such as Baez or Velhinho. Concepts like holonomies, connections and gauge transformations can be naturally formulated in that language. In this formulation, the (spatial) diffeomorphisms appear as the path grouopid automorphisms. We investigate the effect of extending the diffeomorphisms to all such automorphisms, which can be viewed as \"distributional diffeomorphisms\". We also give a notion of \"categorial holonomy-flux-algebra\", and present the construction of the automorphism-invariant Hilbert space for abelian gauge groups, which will be entirely combinatorial.