We analyse the solution spaces of limit periodic homogeneous linear difference systems, where the coefficient matrices of the considered systems are taken from a commutative group which does not need to be bounded. In particular, we study such systems whose fundamental matrices are not asymptotically almost periodic or which have solutions vanishing at infinity. We identify a simple condition on the matrix group which guarantees that the studied systems form a dense subset in the space of all considered systems. The obtained results improve previously known theorems about non-almost periodic and non-asymptotically almost periodic solutions. Note that the elements of the coefficient matrices are taken from an infinite field with an absolute value and that the corresponding almost periodic case is treated as well.