Many scientific applications need to solve very large sparse linear systems in order to simulate phenomena close to the reality. Grid computing is an answer to the growing demand of computational power. In a grid computing environment, communication times are significant and the bandwidth is variable, therefore frequent synchronizations slow down performances. Thus it is desirable to reduce the number of synchronizations in a parallel direct algorithm. Inspired from multisplitting techniques, the GREMLINS (GRid Efficient Methods for LINear Systems) solver we developed consists of solving several linear problems obtained by splitting. The principle of the balancing algorithm is presented, and experimental results are given.