Imitative and contrarian behaviours are the two typical opposite attitudes of investors in stock markets. We introduce a simple model to investigate their interplay in a stock market where agents can take only two states, bullish or bearish. Each bullish (bearish) agent polls m ‘friends’ and changes her opinion to bearish (bullish) if (i) at least m ρ hb ( m ρ bh ) among the m agents inspected are bearish (bullish) or (ii) at least m ρ hh > m ρ hb ( m ρ bb > m ρ bh ) among the m agents inspected are bullish (bearish). The condition (i) ((ii)) corresponds to imitative (antagonistic) behaviour. In the limit where the number N of agents is infinite, the dynamics of the fraction of bullish agents is deterministic and exhibits chaotic behaviour in a significant domain of the parameter space {ρ hb ,ρ bh ,ρ hh ,ρ bb , m }. A typical chaotic trajectory is characterized by intermittent phases of chaos, quasi-periodic behaviour and super-exponentially growing bubbles followed by crashes. A typical bubble starts initially by growing at an exponential rate and then crosses over to a nonlinear power-law growth rate leading to a finite-time singularity. The reinjection mechanism provided by the contrarian behaviour introduces a finite-size effect, rounding off these singularities and leads to chaos. We document the main stylized facts of this model in the symmetric and asymmetric cases. This model is one of the rare agent-based models that give rise to interesting non-periodic complex dynamics in the ‘thermodynamic’ limit (of an infinite number N of agents). We also discuss the case of a finite number of agents, which introduces an endogenous source of noise superimposed on the chaotic dynamics.