Freeze the embedding layer weights