Comments (6)
kaiidams
commented on May 19, 2024
1
Original package path was pytorch_pretrained_bert, Huggingface Transformer changed it in this commit.
huggingface/transformers@0bab55d#diff-415debafd5265b334603c02768a29b0d
from azureml-bert.
kaiidams
commented on May 19, 2024
With BertTokenizer from Huggingface's Transformer, the script stops complaining. Not sure if it is compatible with Azure ML's Transformer.
from pytorch_transformers.tokenization_bert import BertTokenizer
from azureml-bert.
kaiidams
commented on May 19, 2024
pretrain/PyTorch/docker/Dockerfile have this line. It seems pytorch-pretrained-bert v0.6.2 is expected instead of pytorch-transformers v1.0.0. README.md should specify which version to use.
RUN /opt/miniconda/envs/amlbert/bin/pip install --no-cache-dir pytorch-pretrained-bert==0.6.2 && \
from azureml-bert.
xiaoyongzhu
commented on May 19, 2024
Hi @kaiidams looks you are right... Huggingface has changed their folder structure.
from azureml-bert.
skaarthik
commented on May 19, 2024
@kaiidams if you are interested, feel free to send a PR to update the README file.
from azureml-bert.
skaarthik
commented on May 19, 2024
Merged the PR.
from azureml-bert.
Related Issues (20)
- Bert Data for Pretraining: No such file or directory: 'bert_data/validation_512_only' HOT 5
- Using RDMA capable nodes HOT 3
- Dedicated vs. Low-priority servers
- Issues with finetune examples
- dataloading error HOT 3
- Can't use "local" computing in BERT_Eval_SQUAD.ipynb
- docker folder doesn't exist for pretrain HOT 1
- validation data is missing HOT 1
- Expected pretraining results (e.g., loss, next-sentence-prediction accuracy, etc.)
- how can I get ip of master node HOT 1
- broken dataprep link HOT 1
- broken modified run_classifier.py link for hyperdrive
- GPU service with Azure machine learning HOT 1
- Tensor size doesn't match.
- question on time estimates for 'reasonable' p/retraining of 'reasonable' dataset size HOT 2
- Error occurred: No module named 'tqdm' HOT 1
- total languages supported
- BERTopic not working on AzureML
- This repo is missing important files
- Using the original wikipedia dataset
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from azureml-bert.