towards an operational model of
play

TOWARDS AN OPERATIONAL MODEL OF SCHEDULES IN TENSOR EXPRESSION Yuan - PowerPoint PPT Presentation

TOWARDS AN OPERATIONAL MODEL OF SCHEDULES IN TENSOR EXPRESSION Yuan Lin and Yongfeng Gu 2019-12-05 Q Question: is this a legal schedule? Q Illegal, but why? TVMError: Check failed: found_attach || stage_attach.size() == 0: Invalid


  1. TOWARDS AN OPERATIONAL MODEL OF SCHEDULES IN TENSOR EXPRESSION Yuan Lin and Yongfeng Gu 2019-12-05

  2. Q Question: is this a legal schedule?

  3. Q Illegal, but why? TVMError: Check failed: found_attach || stage_attach.size() == 0: Invalid Schedule, cannot find the producer compute(B, 0x2851e60) along the loop nest specified by compute_at of consumer compute(B.local, 0x2b83b00)

  4. Show the Schedule Tree

  5. Violation of Legality LCA(BL, C) LCA(B, C) Illegal

  6. A Possible Fix LCA(B, C) LCA(BL, C) Legal

  7. Background Motivations • Describe schedule primitives and transformations in a more elaborate way • Provide guidance to new TE users • Help debugging tricky TE programs • Provide a framework to discuss bugs (is this a bug or feature?) • Ensure conherent development of new features

  8. The Operational Model Tensor Expression Dataflow Graph Schedule Tree IterVar-relation DAG

  9. The Document

  10. Example pages

  11. Help Needed! • We would like to contribute the document to the TVM community. • We are also working on a visualization tool, Tensor Expression Debug Display (TEDD). • Questions/Survey: • Is this model helpful? • Is this or similar model well understood? • Will you use it for future discussion? • Let's work together to • improve the model • complete the document

  12. Thank you

Recommend


More recommend