Skip to content

Commit b76f4e8

Browse files
ShriyaRishabshriyapb
ShriyaRishab
and
shriyapb
authored
Update training benchmarks list for v5.0 and retire benchmarks (#789)
* Retire gpt3 and Mixtral8x22b pretraining benchmarks * Add v5.0 benchmarks table --------- Co-authored-by: ShriyaRishab <[email protected]>
1 parent ece3d15 commit b76f4e8

File tree

207 files changed

+15
-0
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

207 files changed

+15
-0
lines changed

‎README.md

Lines changed: 15 additions & 0 deletions

‎large_language_model/megatron-lm/.gitignore renamed to ‎retired_benchmarks/gpt3/megatron-lm/.gitignore

File renamed without changes.

‎large_language_model/megatron-lm/Dockerfile renamed to ‎retired_benchmarks/gpt3/megatron-lm/Dockerfile

File renamed without changes.

‎large_language_model/megatron-lm/LICENSE renamed to ‎retired_benchmarks/gpt3/megatron-lm/LICENSE

File renamed without changes.

‎large_language_model/megatron-lm/README.md renamed to ‎retired_benchmarks/gpt3/megatron-lm/README.md

‎large_language_model/megatron-lm/checksums/additional_checkpoint_files/common.pt renamed to ‎retired_benchmarks/gpt3/megatron-lm/checksums/additional_checkpoint_files/common.pt

File renamed without changes.

‎large_language_model/megatron-lm/checksums/additional_checkpoint_files/metadata.json renamed to ‎retired_benchmarks/gpt3/megatron-lm/checksums/additional_checkpoint_files/metadata.json

File renamed without changes.

‎large_language_model/megatron-lm/checksums/dataset_checksum.log renamed to ‎retired_benchmarks/gpt3/megatron-lm/checksums/dataset_checksum.log

File renamed without changes.

‎large_language_model/megatron-lm/checksums/fp32_checkpoint_checksum.log renamed to ‎retired_benchmarks/gpt3/megatron-lm/checksums/fp32_checkpoint_checksum.log

File renamed without changes.

‎large_language_model/megatron-lm/megatron/__init__.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/__init__.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/arguments.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/arguments.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/checkpointing.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/checkpointing.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/core/dist_checkpointing/__init__.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/core/dist_checkpointing/__init__.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/core/dist_checkpointing/core.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/core/dist_checkpointing/core.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/core/dist_checkpointing/dict_utils.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/core/dist_checkpointing/dict_utils.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/core/dist_checkpointing/mapping.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/core/dist_checkpointing/mapping.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/core/dist_checkpointing/optimizer.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/core/dist_checkpointing/optimizer.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/core/dist_checkpointing/serialization.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/core/dist_checkpointing/serialization.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/core/dist_checkpointing/strategies/__init__.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/core/dist_checkpointing/strategies/__init__.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/core/dist_checkpointing/strategies/base.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/core/dist_checkpointing/strategies/base.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/core/dist_checkpointing/strategies/zarr.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/core/dist_checkpointing/strategies/zarr.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/core/dist_checkpointing/tests/__init__.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/core/dist_checkpointing/tests/__init__.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/core/dist_checkpointing/tests/common.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/core/dist_checkpointing/tests/common.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/core/dist_checkpointing/tests/test_correctness.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/core/dist_checkpointing/tests/test_correctness.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/core/dist_checkpointing/tests/test_load_check.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/core/dist_checkpointing/tests/test_load_check.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/core/dist_checkpointing/utils.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/core/dist_checkpointing/utils.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/data/Makefile renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/data/Makefile

File renamed without changes.

‎large_language_model/megatron-lm/megatron/data/__init__.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/data/__init__.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/data/autoaugment.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/data/autoaugment.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/data/biencoder_dataset_utils.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/data/biencoder_dataset_utils.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/data/blendable_dataset.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/data/blendable_dataset.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/data/data_samplers.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/data/data_samplers.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/data/dataset_utils.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/data/dataset_utils.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/data/gpt_dataset.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/data/gpt_dataset.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/data/helpers.cpp renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/data/helpers.cpp

File renamed without changes.

‎large_language_model/megatron-lm/megatron/data/ict_dataset.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/data/ict_dataset.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/data/indexed_dataset.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/data/indexed_dataset.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/data/orqa_wiki_dataset.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/data/orqa_wiki_dataset.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/data/realm_dataset_utils.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/data/realm_dataset_utils.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/data/realm_index.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/data/realm_index.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/data/test/test_indexed_dataset.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/data/test/test_indexed_dataset.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/data/test/test_preprocess_data.sh renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/data/test/test_preprocess_data.sh

File renamed without changes.

‎large_language_model/megatron-lm/megatron/dist_signal_handler.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/dist_signal_handler.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/fp16_deprecated/loss_scaler.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/fp16_deprecated/loss_scaler.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/fused_kernels/__init__.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/fused_kernels/__init__.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/fused_kernels/compat.h renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/fused_kernels/compat.h

File renamed without changes.

‎large_language_model/megatron-lm/megatron/fused_kernels/fused_weight_gradient_dense.cpp renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/fused_kernels/fused_weight_gradient_dense.cpp

File renamed without changes.

‎large_language_model/megatron-lm/megatron/fused_kernels/fused_weight_gradient_dense.cu renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/fused_kernels/fused_weight_gradient_dense.cu

File renamed without changes.

‎large_language_model/megatron-lm/megatron/fused_kernels/layer_norm_cuda.cpp renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/fused_kernels/layer_norm_cuda.cpp

File renamed without changes.

‎large_language_model/megatron-lm/megatron/fused_kernels/layer_norm_cuda_kernel.cu renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/fused_kernels/layer_norm_cuda_kernel.cu

File renamed without changes.

‎large_language_model/megatron-lm/megatron/fused_kernels/scaled_masked_softmax.cpp renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/fused_kernels/scaled_masked_softmax.cpp

File renamed without changes.

‎large_language_model/megatron-lm/megatron/fused_kernels/scaled_masked_softmax.h renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/fused_kernels/scaled_masked_softmax.h

File renamed without changes.

‎large_language_model/megatron-lm/megatron/fused_kernels/scaled_masked_softmax_cuda.cu renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/fused_kernels/scaled_masked_softmax_cuda.cu

File renamed without changes.

‎large_language_model/megatron-lm/megatron/fused_kernels/scaled_softmax.cpp renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/fused_kernels/scaled_softmax.cpp

File renamed without changes.

‎large_language_model/megatron-lm/megatron/fused_kernels/scaled_softmax_cuda.cu renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/fused_kernels/scaled_softmax_cuda.cu

File renamed without changes.

‎large_language_model/megatron-lm/megatron/fused_kernels/scaled_upper_triang_masked_softmax.cpp renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/fused_kernels/scaled_upper_triang_masked_softmax.cpp

File renamed without changes.

‎large_language_model/megatron-lm/megatron/fused_kernels/scaled_upper_triang_masked_softmax.h renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/fused_kernels/scaled_upper_triang_masked_softmax.h

File renamed without changes.

‎large_language_model/megatron-lm/megatron/fused_kernels/scaled_upper_triang_masked_softmax_cuda.cu renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/fused_kernels/scaled_upper_triang_masked_softmax_cuda.cu

File renamed without changes.

‎large_language_model/megatron-lm/megatron/fused_kernels/tests/__init__.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/fused_kernels/tests/__init__.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/fused_kernels/tests/test_fused_kernels.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/fused_kernels/tests/test_fused_kernels.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/fused_kernels/type_shim.h renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/fused_kernels/type_shim.h

File renamed without changes.

‎large_language_model/megatron-lm/megatron/global_vars.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/global_vars.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/indexer.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/indexer.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/initialize.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/initialize.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/learning_rates.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/learning_rates.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/memory.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/memory.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/microbatches.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/microbatches.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/model/__init__.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/model/__init__.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/model/biencoder_model.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/model/biencoder_model.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/model/classification.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/model/classification.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/model/distributed.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/model/distributed.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/model/enums.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/model/enums.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/model/fused_bias_gelu.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/model/fused_bias_gelu.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/model/fused_layer_norm.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/model/fused_layer_norm.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/model/fused_softmax.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/model/fused_softmax.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/model/gpt_model.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/model/gpt_model.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/model/language_model.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/model/language_model.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/model/module.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/model/module.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/model/multiple_choice.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/model/multiple_choice.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/model/realm_model.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/model/realm_model.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/model/transformer.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/model/transformer.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/model/utils.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/model/utils.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/mpu/__init__.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/mpu/__init__.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/mpu/cross_entropy.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/mpu/cross_entropy.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/mpu/data.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/mpu/data.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/mpu/initialize.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/mpu/initialize.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/mpu/layers.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/mpu/layers.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/mpu/mappings.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/mpu/mappings.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/mpu/random.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/mpu/random.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/mpu/tests/__init__.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/mpu/tests/__init__.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/mpu/tests/commons.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/mpu/tests/commons.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/mpu/tests/test_cross_entropy.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/mpu/tests/test_cross_entropy.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/mpu/tests/test_data.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/mpu/tests/test_data.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/mpu/tests/test_initialize.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/mpu/tests/test_initialize.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/mpu/tests/test_layers.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/mpu/tests/test_layers.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/mpu/tests/test_random.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/mpu/tests/test_random.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/mpu/utils.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/mpu/utils.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/optimizer/__init__.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/optimizer/__init__.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/optimizer/clip_grads.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/optimizer/clip_grads.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/optimizer/distrib_optimizer.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/optimizer/distrib_optimizer.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/optimizer/grad_scaler.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/optimizer/grad_scaler.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/optimizer/optimizer.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/optimizer/optimizer.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/optimizer_param_scheduler.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/optimizer_param_scheduler.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/p2p_communication.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/p2p_communication.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/schedules.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/schedules.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/static/index.html renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/static/index.html

File renamed without changes.

‎large_language_model/megatron-lm/megatron/text_generation/__init__.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/text_generation/__init__.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/text_generation/api.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/text_generation/api.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/text_generation/beam_utils.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/text_generation/beam_utils.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/text_generation/communication.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/text_generation/communication.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/text_generation/forward_step.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/text_generation/forward_step.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/text_generation/generation.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/text_generation/generation.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/text_generation/sampling.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/text_generation/sampling.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/text_generation/tokenization.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/text_generation/tokenization.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/text_generation_server.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/text_generation_server.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/timers.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/timers.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/tokenizer/__init__.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/tokenizer/__init__.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/tokenizer/bert_tokenization.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/tokenizer/bert_tokenization.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/tokenizer/gpt2_tokenization.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/tokenizer/gpt2_tokenization.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/tokenizer/tokenizer.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/tokenizer/tokenizer.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/training.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/training.py

File renamed without changes.

‎large_language_model/megatron-lm/megatron/utils.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/megatron/utils.py

File renamed without changes.

‎large_language_model/megatron-lm/pretrain_gpt.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/pretrain_gpt.py

File renamed without changes.

‎large_language_model/megatron-lm/requirements.txt renamed to ‎retired_benchmarks/gpt3/megatron-lm/requirements.txt

File renamed without changes.

‎large_language_model/megatron-lm/run_gpt3.sh renamed to ‎retired_benchmarks/gpt3/megatron-lm/run_gpt3.sh

File renamed without changes.

‎large_language_model/megatron-lm/scripts/common_bf16.json renamed to ‎retired_benchmarks/gpt3/megatron-lm/scripts/common_bf16.json

File renamed without changes.

‎large_language_model/megatron-lm/scripts/common_fp32.json renamed to ‎retired_benchmarks/gpt3/megatron-lm/scripts/common_fp32.json

File renamed without changes.

‎large_language_model/megatron-lm/scripts/convert_paxml_to_megatron_distributed.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/scripts/convert_paxml_to_megatron_distributed.py

File renamed without changes.

‎large_language_model/megatron-lm/scripts/json_to_torch.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/scripts/json_to_torch.py

File renamed without changes.

‎large_language_model/megatron-lm/scripts/load_checkpoint.md renamed to ‎retired_benchmarks/gpt3/megatron-lm/scripts/load_checkpoint.md

‎large_language_model/megatron-lm/scripts/load_checkpoint.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/scripts/load_checkpoint.py

File renamed without changes.

‎large_language_model/megatron-lm/scripts/preprocess.sh renamed to ‎retired_benchmarks/gpt3/megatron-lm/scripts/preprocess.sh

File renamed without changes.

‎large_language_model/megatron-lm/scripts/preprocess_val.sh renamed to ‎retired_benchmarks/gpt3/megatron-lm/scripts/preprocess_val.sh

File renamed without changes.

‎large_language_model/megatron-lm/tasks/data_utils.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/data_utils.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/ensemble_classifier.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/ensemble_classifier.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/eval_utils.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/eval_utils.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/finetune_utils.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/finetune_utils.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/glue/data.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/glue/data.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/glue/finetune.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/glue/finetune.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/glue/mnli.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/glue/mnli.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/glue/qqp.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/glue/qqp.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/main.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/main.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/orqa/README.md renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/orqa/README.md

‎large_language_model/megatron-lm/tasks/orqa/evaluate_orqa.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/orqa/evaluate_orqa.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/orqa/evaluate_utils.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/orqa/evaluate_utils.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/orqa/supervised/data.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/orqa/supervised/data.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/orqa/supervised/eval_utils.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/orqa/supervised/eval_utils.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/orqa/supervised/finetune.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/orqa/supervised/finetune.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/orqa/unsupervised/nq.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/orqa/unsupervised/nq.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/orqa/unsupervised/qa_utils.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/orqa/unsupervised/qa_utils.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/orqa/unsupervised/tokenizers.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/orqa/unsupervised/tokenizers.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/race/data.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/race/data.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/race/finetune.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/race/finetune.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/vision/classification.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/vision/classification.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/vision/eval_utils.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/vision/eval_utils.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/vision/finetune_utils.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/vision/finetune_utils.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/vision/main.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/vision/main.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/zeroshot_gpt/datasets.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/zeroshot_gpt/datasets.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/zeroshot_gpt/detokenizer.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/zeroshot_gpt/detokenizer.py

File renamed without changes.

‎large_language_model/megatron-lm/tasks/zeroshot_gpt/evaluate.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tasks/zeroshot_gpt/evaluate.py

File renamed without changes.

‎large_language_model/megatron-lm/tools/preprocess_data.py renamed to ‎retired_benchmarks/gpt3/megatron-lm/tools/preprocess_data.py

File renamed without changes.

‎large_language_model/paxml/README.md renamed to ‎retired_benchmarks/gpt3/paxml/README.md

‎large_language_model/paxml/c4.py renamed to ‎retired_benchmarks/gpt3/paxml/c4.py

File renamed without changes.

‎large_language_model/paxml/c4_mllog.py renamed to ‎retired_benchmarks/gpt3/paxml/c4_mllog.py

File renamed without changes.

‎large_language_model/paxml/lm_cloud.py renamed to ‎retired_benchmarks/gpt3/paxml/lm_cloud.py

File renamed without changes.

‎large_language_model/paxml/model_params.py renamed to ‎retired_benchmarks/gpt3/paxml/model_params.py

File renamed without changes.

‎large_language_model/paxml/utils/generate_spm.md renamed to ‎retired_benchmarks/gpt3/paxml/utils/generate_spm.md

‎large_language_model/paxml/utils/load_ts_ckpt.md renamed to ‎retired_benchmarks/gpt3/paxml/utils/load_ts_ckpt.md

‎large_language_model/paxml/utils/load_ts_ckpt.py renamed to ‎retired_benchmarks/gpt3/paxml/utils/load_ts_ckpt.py

File renamed without changes.

‎large_language_model/paxml/utils/select_example.md renamed to ‎retired_benchmarks/gpt3/paxml/utils/select_example.md

‎large_language_model/paxml/utils/select_example.py renamed to ‎retired_benchmarks/gpt3/paxml/utils/select_example.py

File renamed without changes.

‎large_language_model/paxml/utils/select_text.py renamed to ‎retired_benchmarks/gpt3/paxml/utils/select_text.py

File renamed without changes.

‎mixture_of_experts_pretraining/README.md renamed to ‎retired_benchmarks/mixtral8x22b/README.md

‎mixture_of_experts_pretraining/clm_datasets.py renamed to ‎retired_benchmarks/mixtral8x22b/clm_datasets.py

File renamed without changes.

‎mixture_of_experts_pretraining/config/config.yaml renamed to ‎retired_benchmarks/mixtral8x22b/config/config.yaml

File renamed without changes.

‎mixture_of_experts_pretraining/config/dataset/c4_mlperf.yaml renamed to ‎retired_benchmarks/mixtral8x22b/config/dataset/c4_mlperf.yaml

File renamed without changes.

‎mixture_of_experts_pretraining/config/dataset/wikitext.yaml renamed to ‎retired_benchmarks/mixtral8x22b/config/dataset/wikitext.yaml

File renamed without changes.

‎mixture_of_experts_pretraining/config/experiment/convergence_template.yaml renamed to ‎retired_benchmarks/mixtral8x22b/config/experiment/convergence_template.yaml

File renamed without changes.

‎mixture_of_experts_pretraining/config/experiment/gbs256_tpu.yaml renamed to ‎retired_benchmarks/mixtral8x22b/config/experiment/gbs256_tpu.yaml

File renamed without changes.

‎mixture_of_experts_pretraining/config/model/blank_model.yaml renamed to ‎retired_benchmarks/mixtral8x22b/config/model/blank_model.yaml

File renamed without changes.

‎mixture_of_experts_pretraining/config/sched/CosineAnnealing.yaml renamed to ‎retired_benchmarks/mixtral8x22b/config/sched/CosineAnnealing.yaml

File renamed without changes.

‎mixture_of_experts_pretraining/config/sched/WarmupHoldPolicy.yaml renamed to ‎retired_benchmarks/mixtral8x22b/config/sched/WarmupHoldPolicy.yaml

File renamed without changes.

‎mixture_of_experts_pretraining/docker/gpu/Dockerfile renamed to ‎retired_benchmarks/mixtral8x22b/docker/gpu/Dockerfile

File renamed without changes.

‎mixture_of_experts_pretraining/docker/gpu/Dockerfile.GCP renamed to ‎retired_benchmarks/mixtral8x22b/docker/gpu/Dockerfile.GCP

File renamed without changes.

‎mixture_of_experts_pretraining/docker/gpu/build_and_push_image.sh renamed to ‎retired_benchmarks/mixtral8x22b/docker/gpu/build_and_push_image.sh

File renamed without changes.

‎mixture_of_experts_pretraining/docker/gpu/megatron_core.patch renamed to ‎retired_benchmarks/mixtral8x22b/docker/gpu/megatron_core.patch

File renamed without changes.

‎mixture_of_experts_pretraining/docker/tpu/Dockerfile renamed to ‎retired_benchmarks/mixtral8x22b/docker/tpu/Dockerfile

File renamed without changes.

‎mixture_of_experts_pretraining/docker/tpu/build_and_push_image.sh renamed to ‎retired_benchmarks/mixtral8x22b/docker/tpu/build_and_push_image.sh

File renamed without changes.

‎mixture_of_experts_pretraining/download_dataset.py renamed to ‎retired_benchmarks/mixtral8x22b/download_dataset.py

File renamed without changes.

‎mixture_of_experts_pretraining/file_utils.py renamed to ‎retired_benchmarks/mixtral8x22b/file_utils.py

File renamed without changes.

‎mixture_of_experts_pretraining/helm_context/Chart.yaml renamed to ‎retired_benchmarks/mixtral8x22b/helm_context/Chart.yaml

File renamed without changes.

‎mixture_of_experts_pretraining/helm_context/selected-configuration.yaml renamed to ‎retired_benchmarks/mixtral8x22b/helm_context/selected-configuration.yaml

File renamed without changes.

‎mixture_of_experts_pretraining/helm_context/templates/nemo-example.yaml renamed to ‎retired_benchmarks/mixtral8x22b/helm_context/templates/nemo-example.yaml

File renamed without changes.

‎mixture_of_experts_pretraining/helm_context/values.yaml renamed to ‎retired_benchmarks/mixtral8x22b/helm_context/values.yaml

File renamed without changes.

‎mixture_of_experts_pretraining/mixtral80.json renamed to ‎retired_benchmarks/mixtral8x22b/mixtral80.json

File renamed without changes.

‎mixture_of_experts_pretraining/mixtral822-instruct.json renamed to ‎retired_benchmarks/mixtral8x22b/mixtral822-instruct.json

File renamed without changes.

‎mixture_of_experts_pretraining/mixtral822.json renamed to ‎retired_benchmarks/mixtral8x22b/mixtral822.json

File renamed without changes.

‎mixture_of_experts_pretraining/mixtral87.json renamed to ‎retired_benchmarks/mixtral8x22b/mixtral87.json

File renamed without changes.

‎mixture_of_experts_pretraining/mlperf_logging_utils.py renamed to ‎retired_benchmarks/mixtral8x22b/mlperf_logging_utils.py

File renamed without changes.

‎mixture_of_experts_pretraining/model_utils_gpu.py renamed to ‎retired_benchmarks/mixtral8x22b/model_utils_gpu.py

File renamed without changes.

‎mixture_of_experts_pretraining/model_utils_tpu.py renamed to ‎retired_benchmarks/mixtral8x22b/model_utils_tpu.py

File renamed without changes.

‎mixture_of_experts_pretraining/run_clm.py renamed to ‎retired_benchmarks/mixtral8x22b/run_clm.py

File renamed without changes.

‎mixture_of_experts_pretraining/scripts/gpu/checkpoint_download.py renamed to ‎retired_benchmarks/mixtral8x22b/scripts/gpu/checkpoint_download.py

File renamed without changes.

‎mixture_of_experts_pretraining/scripts/gpu/dataset_preprocessing.py renamed to ‎retired_benchmarks/mixtral8x22b/scripts/gpu/dataset_preprocessing.py

File renamed without changes.

‎mixture_of_experts_pretraining/scripts/gpu/run.sub renamed to ‎retired_benchmarks/mixtral8x22b/scripts/gpu/run.sub

File renamed without changes.

‎mixture_of_experts_pretraining/scripts/tpu/distributed_checkpoint_saving.py renamed to ‎retired_benchmarks/mixtral8x22b/scripts/tpu/distributed_checkpoint_saving.py

File renamed without changes.

‎mixture_of_experts_pretraining/trainer_utils_tpu.py renamed to ‎retired_benchmarks/mixtral8x22b/trainer_utils_tpu.py

File renamed without changes.

0 commit comments

Comments
 (0)