In this paper, we propose a generalized solution for lymphocyte detection and segmentation, based on a novel image feature extraction method, named exclusive autoencoder (XAE). XAE is compatible with conventional autoencoder (AE) and able to provide additional information about the categorization in the feature space. For the task of lymphocyte detection, XAE was able to reach the an F-score of 99.96%, outperforming the state-of-the-art methods (reporting an F-score of 90%). Further, based on the integration of XAE+FCN (fully connected network) and conventional image processing function blocks provided in CellProfiler, we propose a lymphocyte segmentation pipeline. The obtained Dice coefficient reached 88.31% while the cutting-edge approach was at 74%.