error running code about transformer HOT 6 OPEN

-  tril = tf.contrib.linalg.LinearOperatorTriL(diag_vals).to_dense() # (T_q, T_k)
+  tril = tf.linalg.LinearOperatorLowerTriangular(diag_vals).to_dense() # (T_q, T_k)

from transformer.

function has been changed to LinearOperatorLowerTriangular

from transformer.

Thank you! I have the same problem and it works for me!

from transformer.

function has been changed to LinearOperatorLowerTriangular

Hi, bro, how do you deal with such VERSION problems? I think google should add some instructions in the history versions.

from transformer.

Hello I am getting a similar error.
File "/Users/aishwarya/Desktop/transformers/modules.py", line 227, in multihead_attention
tril = tf.contrib.linalg.LinearOperatorLowerTriangular(diag_vals).to_dense() # (T_q, T_k)
AttributeError: module 'tensorflow.contrib' has no attribute 'linalg'

My tf version is - 1.13.0-dev20181108
Any guidance will be really helpful.

from transformer.

Hello I am getting a similar error.
File "/Users/aishwarya/Desktop/transformers/modules.py", line 227, in multihead_attention
tril = tf.contrib.linalg.LinearOperatorLowerTriangular(diag_vals).to_dense() # (T_q, T_k)
AttributeError: module 'tensorflow.contrib' has no attribute 'linalg'

My tf version is - 1.13.0-dev20181108
Any guidance will be really helpful.

I think you should exclude 'contrib' when you use this function.
In my case, it works well (tf version 1.12.0)

from transformer.