Once we got enough resources in GPU and storage, publish paper to top tier conference would not be the only choices, we can really shipping something seems common to inner circle but means a lot to outsiders. This is what Alec Radford found the magic of GPT-1.