We released an open-source 1.5b BUT-FIT/Czech-GPT-2-XL-133k czech language model checkpoint. This is an intermediate result of our ongoing work on SEMANT project here at BUT.