In the present study, we investigated the ability to assign moral responsibility and punishment in adults with high functioning autism or Asperger Syndrome (HFA/AS), using non-verbal cartoons depicting an aggression, an accidental harm or a mere coincidence. Participants were asked to evaluate the agent’s causal and intentional roles, his responsibility and the punishment he deserves for his action. Adults with HFA/AS did not differ in judgments of suffering and causality from adults with typical development. However, subtle difficulties with judgments of intentional action and moral judgments were observed in participants with HFA/AS. These results are discussed in the light of emerging studies that deal with integrity of moral reasoning in individuals with autism spectrum disorders.