High-resolution observations of the full Stokes vector in FeI spectral lines around 5250 Angstroms obtained at the Swedish Vacuum Solar Telescope on La Palma with the ZIMPOL I Stokes polarimeter in a complex active region reveal the presence of anomalously shaped Stokes profiles indicating the coexistence of at least two magnetic components within the same spatial resolution element. These Stokes profiles have been analyzed with an inversion code based on a 3-component atmospheric model with two magnetic and one field- free component. The fits to the observations in a magnetic region that resembles a small penumbra reveal the presence of a horizontal magnetic field component with an average field strength of /lineB=840 G, a mean filling factor of α=0.12, and an average temperature T=5400 K at log tau_5000=-1.5 embedded in the main ``penumbral’’ magnetic field that has B=1500 G, α=0.56, and eT=4900 K. The horizontal component exhibits a mean outflow of 2.7 km/s which is mainly due to the Evershed flow. In a region where there are strong downflows up to 7 km/s, we infer the possible presence of a shock front whose height changes along the slit. The height variation can be explained by a change of the gas pressure at the base of the photosphere below the shock front as proposed by Thomas & Montesinos (1991). Small plages with field strengths below 900 G have been observed in the vicinity of some pores. Finally, we present a puzzling field structure at the boundary between two adjacent pores. Ambiguous results suggest that although the inversion code is able to successfully invert even very complex Stokes profiles, we are far from a complete description of the field structure in complex magnetic regions. We warn that magnetograms and fits to data involving only a single magnetic component may hide the true complexity of the magnetic structure in at least some parts of active regions.