1BillionWordLanguageModelBenchmark.Thepurposeoftheprojectistomakeavailableastandardtrainingandtestsetupforlanguagemodelingexperiments.