Ab initio treatment of large molecular systems: algorithm development, parallelization and applications