This paper presents a new method to reduce the computational cost when using Neural Networks as Language Models. during recognition. in some particular scenarios. It is based on a Neural Network that considers input contexts of different length in order to ease the use of a fallback mechanism together with the precomputation of softmax normalization constants for these inputs. https://mylittlewardrobers.shop/product-category/dummy-clip/