目录

目录
 1
 2
 3
 4
 5
 6
 7
 8
 9
10
flowchart TB
A(Stary)-->B["mindformers.__init__.py"]
B --> C["register(CausalLanguageModelingTrainerregister)"]
A --> D[run_mindformer.py]
D --> E["trainer=Trainer(config)"]
E --> F["trainer=MindFormerRegister.get_instance_from_cfg(config={type: CausalLanguageModelingTrainer,model_name:'llama2_70b'})"] 
F --> G["trainer=CausalLanguageModelingTrainer(model_name)"]
D --> H["trainer.predict()"]
H --> I["CausalLanguageModelingTrainer.predict(config,input_data,task,network,tokenizer)"]
I --> J["base_trainer.predict_process()"]

predict_process里创建pipeline,pipeline调用的是task。

1
2
flowchart TB
run_mindformer.py --> trainer.py --> causal_language_modeling.py --> base_trainer.py

构建网络使用的是config.model的配置,核心逻辑在base_trianer.pycreate_network函数里。