clang interface stubs
play

Clang Interface Stubs Syntax Directed Stub Library Generation Puyan - PowerPoint PPT Presentation

Jun 14, 2023 •314 likes •568 views

Clang Interface Stubs Syntax Directed Stub Library Generation Puyan Lotfi Facebook Interface Stubs echo "" | clang -shared -fPIC -x c - -o - | llvm-objdump -section-headers a.out: file format ELF64-x86-64 Sections: Idx Name

  1. Clang Interface Stubs Syntax Directed Stub Library Generation Puyan Lotfi Facebook

  2. Interface Stubs echo "" | clang -shared -fPIC -x c - -o - | llvm-objdump -section-headers a.out: file format ELF64-x86-64 Sections: Idx Name Size Address Type 0 00000000 0000000000000000 1 .dynsym 00000108 00000000000001d0 2 .dynstr 0000008f 00000000000002d8 3 .symtab 00000498 0000000000000000 4 .strtab 00000178 0000000000000000 5 .shstrtab 000000cc 0000000000000000 6 .gnu.hash 0000003c 0000000000000190 7 .gnu.version 00000016 0000000000000368 8 .gnu.version_r 00000020 0000000000000380 9 .rela.dyn 000000a8 00000000000003a0 10 .init 00000017 0000000000000448 TEXT 11 .plt 00000010 0000000000000460 TEXT 12 .plt.got 00000008 0000000000000470 TEXT 13 .text 000000c6 0000000000000480 TEXT 14 .fini 00000009 0000000000000548 TEXT 15 .eh_frame_hdr 00000024 0000000000000554 DATA 16 .eh_frame 0000007c 0000000000000578 DATA 17 .init_array 00000008 0000000000200e40 18 .fini_array 00000008 0000000000200e48 19 .dynamic 00000190 0000000000200e50 20 .got 00000020 0000000000200fe0 DATA 21 .got.plt 00000018 0000000000201000 DATA 22 .data 00000008 0000000000201018 DATA 23 .bss 00000008 0000000000201020 BSS 24 .comment 0000008f 0000000000000000

  3. Interface Stubs echo "" | clang -shared -fPIC -x c - -o - | llvm-objdump -section-headers a.out: file format ELF64-x86-64 Sections: Idx Name Size Address Type 0 00000000 0000000000000000 1 .dynsym 00000108 00000000000001d0 2 .dynstr 0000008f 00000000000002d8 3 .symtab 00000498 0000000000000000 4 .strtab 00000178 0000000000000000 5 .shstrtab 000000cc 0000000000000000 6 .gnu.hash 0000003c 0000000000000190 7 .gnu.version 00000016 0000000000000368 8 .gnu.version_r 00000020 0000000000000380 9 .rela.dyn 000000a8 00000000000003a0 10 .init 00000017 0000000000000448 TEXT 11 .plt 00000010 0000000000000460 TEXT 12 .plt.got 00000008 0000000000000470 TEXT 13 .text 000000c6 0000000000000480 TEXT 14 .fini 00000009 0000000000000548 TEXT 15 .eh_frame_hdr 00000024 0000000000000554 DATA 16 .eh_frame 0000007c 0000000000000578 DATA 17 .init_array 00000008 0000000000200e40 18 .fini_array 00000008 0000000000200e48 19 .dynamic 00000190 0000000000200e50 20 .got 00000020 0000000000200fe0 DATA 21 .got.plt 00000018 0000000000201000 DATA 22 .data 00000008 0000000000201018 DATA 23 .bss 00000008 0000000000201020 BSS 24 .comment 0000008f 0000000000000000

  4. Motivation • Generation of lean SDKs • No Code • Explicit Symbol Exposure • Code as Source of Truth: Syntax Directed • Make use of visibility attributes (ie __attribute__((__visibility__(“hidden”))))

  5. Motivation • Generation of lean SDKs • No Code • Explicit Symbol Exposure • Code as Source of Truth: Syntax Directed • Make use of visibility attributes (ie __attribute__((__visibility__(“hidden”)))) clang -emit-interface-stubs -o libfoo.so a.cpp c.cpp sq.cpp #define hidden __attribute__(( \ __visibility__("hidden"))) .dynsym hidden int b; .dynstr int red() { return b; } .symtab hidden void green() { } .strtab hidden void blue() { } .shstrtab int a; hidden int c;

  6. Prior Art & Approaches • Microsoft’s Import Libraries • Generate stub code from compiler & linker • Syntax directed through __declspec(dllimport/dllexport) • Apple’s TAPI (Text API) • Header Scanning & stub generation • .so/.dylib/.dll scanning & stripping

  7. Clang Interface Stubs • Repurposes visibility attribute to direct symbol exposure using code syntax • Fine grain control (internal SPI vs external API) • Aggregates exposure across compilation units via text • Supports ELF • Yields smaller SDK and faster link times

  8. Clang Driver Pipeline • Traditional Pipeline: Preprocess, Compile, Backend, Assemble, and Link Phases PP COMPILE BE ASM LINK

  9. Clang Driver Pipeline • Traditional Pipeline: Preprocess, Compile, Backend, Assemble, and Link Phases clang -c PP COMPILE BE ASM

  10. Clang Driver Pipeline • Traditional Pipeline: Preprocess, Compile, Backend, Assemble, and Link Phases clang -S PP COMPILE BE

  11. Clang Driver Pipeline • Traditional Pipeline: Preprocess, Compile, Backend, Assemble, and Link Phases clang -fsyntax_only PP COMPILE

  12. Clang Driver Pipeline • Traditional Pipeline: Preprocess, Compile, Backend, Assemble, and Link Phases clang -E PP

  13. Driver Pipeline • Clang Interface Stubs Pipeline: Preprocess, Compile, and Merge phases • Compile Phase: Generates intermediate text (.ifs files) • Merge Phase: Invokes llvm-ifs to consume & merge .ifs files to produce ELF .so • Compile Phase invokes InterfaceStubFunctionsConsumer (clang -cc1) • Walks the AST scanning for visible decls PP COMPILE MERGE

  14. Driver Pipeline • Clang Interface Stubs Pipeline: Preprocess, Compile, and Merge phases • Compile Phase: Generates intermediate text (.ifs files) • Merge Phase: Invokes llvm-ifs to consume & merge .ifs files to produce ELF .so • Compile Phase invokes InterfaceStubFunctionsConsumer (clang -cc1) • Walks the AST scanning for visible decls #define weak \ __attribute__((__weak__)) --- !experimental-ifs-v1 #define hidden __attribute__(( \ IfsVersion: 1.0 __visibility__("hidden"))) Triple: x86_64-unknown-linux-gnu Symbols: COMPILE hidden int b; _Z3redv: { Type: Func } int red() { return b; } _Z5greenv: { Type: Func, weak void green() { } Weak: true } hidden void blue() { } a: { Type: Object, Size: 4 } int a; ... hidden int c;

  15. IFS Text Format --- !experimental-ifs-v1 IfsVersion: 1.0 Triple: x86_64-unknown-linux-gnu Symbols: _Z5brownv: { Type: Func } _Z5greenv: { Type: Func } b: { Type: Object, Size: 4 } black: { Type: Object, Size: 1 } _Z3redv: { Type: Func } _Z4bluev: { Type: Func } _Z3redi: { Type: Func, Weak: true } ...

  16. IFS Text Format --- !experimental-ifs-v1 IfsVersion: 1.0 Triple: x86_64-unknown-linux-gnu Symbols: b: { Type: Object, Size: 4 } black: { Type: Object, Size: 1 } _Z3redv: { Type: Func } --- !experimental-ifs-v1 _Z4bluev: { Type: Func } IfsVersion: 1.0 ... Triple: x86_64-unknown-linux-gnu Symbols: --- !experimental-ifs-v1 _Z5brownv: { Type: Func } IfsVersion: 1.0 _Z5greenv: { Type: Func } llvm-ifs Triple: x86_64-unknown-linux-gnu b: { Type: Object, Size: 4 } black: { Type: Object, Size: 1 } Symbols: _Z3redv: { Type: Func } _Z5brownv: { Type: Func } _Z4bluev: { Type: Func } _Z5greenv: { Type: Func } _Z3redi: { Type: Func, Weak: true } ... ... --- !experimental-ifs-v1 IfsVersion: 1.0 Triple: x86_64-unknown-linux-gnu Symbols: _Z3redi: { Type: Func, Weak: true } ...

  17. llvm-ifs • A new llvm tool for consuming IFS files: produces a merged IFS file, or ELF shared object (.dynsym, .dynstr, .symtab only) --- !experimental-ifs-v1 IfsVersion: 1.0 Triple: x86_64-unknown-linux-gnu Symbols: b: { Type: Object, Size: 4 } black: { Type: Object, Size: 1 } _Z3redv: { Type: Func } --- !experimental-ifs-v1 _Z4bluev: { Type: Func } IfsVersion: 1.0 ... Triple: x86_64-unknown-linux-gnu Symbols: --- !experimental-ifs-v1 _Z5brownv: { Type: Func } IfsVersion: 1.0 _Z5greenv: { Type: Func } llvm-ifs Triple: x86_64-unknown-linux-gnu b: { Type: Object, Size: 4 } black: { Type: Object, Size: 1 } Symbols: _Z3redv: { Type: Func } _Z5brownv: { Type: Func } _Z4bluev: { Type: Func } _Z5greenv: { Type: Func } _Z3redi: { Type: Func, Weak: true } ... ... --- !experimental-ifs-v1 IfsVersion: 1.0 Triple: x86_64-unknown-linux-gnu Symbols: _Z3redi: { Type: Func, Weak: true } ...

  18. llvm-ifs • A new llvm tool for consuming IFS files: produces a merged IFS file, or ELF shared object (.dynsym, .dynstr, .symtab only) --- !experimental-ifs-v1 IfsVersion: 1.0 Triple: x86_64-unknown-linux-gnu Symbols: b: { Type: Object, Size: 4 } black: { Type: Object, Size: 1 } _Z3redv: { Type: Func } _Z4bluev: { Type: Func } ... .dynsym --- !experimental-ifs-v1 .dynstr IfsVersion: 1.0 llvm-ifs .symtab Triple: x86_64-unknown-linux-gnu .strtab Symbols: _Z5brownv: { Type: Func } .shstrtab _Z5greenv: { Type: Func } ... --- !experimental-ifs-v1 IfsVersion: 1.0 Triple: x86_64-unknown-linux-gnu Symbols: _Z3redi: { Type: Func, Weak: true } ...

  19. Example clang -emit-interface-stubs -o libfoo.so a.cpp c.cpp sq.cpp --- !experimental-ifs-v1 IfsVersion: 1.0 MERGE Triple: x86_64-unknown-linux-gnu COMPILE void brown() { } Symbols: (llvm-ifs) int green() { return 42; } _Z5brownv: { Type: Func } _Z5greenv: { Type: Func } ...

Recommend

Interfaces Interfaces interface : A list of methods that a class promises to implement.

Interfaces Interfaces interface : A list of methods that a class promises to implement.

Interfaces Interfaces interface : A list of methods that a class promises to implement. Interfaces give you an is-a relationship without code sharing. Only method stubs in the interface Allows object with no common ancestor to act

268 views • 13 slides
Interfaces Interfaces n interface : A list of methods that a class promises to implement. q

Interfaces Interfaces n interface : A list of methods that a class promises to implement. q

10/21/12 Interfaces Interfaces n interface : A list of methods that a class promises to implement. q Interfaces give you an is-a relationship without code sharing. Only method stubs in the interface n Allows object with no common

421 views • 7 slides
An update on Clang-based C++ Tooling Manuel Klimek Daniel Jasper Tomorrowland (from Euro LLVM

An update on Clang-based C++ Tooling Manuel Klimek Daniel Jasper Tomorrowland (from Euro LLVM

An update on Clang-based C++ Tooling Manuel Klimek Daniel Jasper Tomorrowland (from Euro LLVM DevMeeting 2012) Tools Editor integration clang-format Emacs clang-lint Vim clang-rename Eclipse

122 views • 8 slides
Developing the Clang Static Analyzer Artem Dergachev, Apple Clang Static Analyzer Finds bugs

Developing the Clang Static Analyzer Artem Dergachev, Apple Clang Static Analyzer Finds bugs

Developing the Clang Static Analyzer Artem Dergachev, Apple Clang Static Analyzer Finds bugs at compile time by inspecting your source code Bugs it finds are more sophisticated than warnings or Clang-Tidy Clang Static Analyzer 1

544 views • 29 slides
Life of an instruction in Clang / LLVM Francis Visoiu Mistrih - francis@lse.epita.fr 1 / 20

Life of an instruction in Clang / LLVM Francis Visoiu Mistrih - francis@lse.epita.fr 1 / 20

Life of an instruction in Clang / LLVM Francis Visoiu Mistrih - francis@lse.epita.fr 1 / 20 Clang foo.c - C int foo(int a, int b) { return a + b; } 2 / 20 Clang AST clang-check -ast-dump foo.c TranslationUnitDecl 0x29eaa20

225 views • 20 slides
The Clang AST A Tutorial by Manuel Klimek You'll learn: 1. The basic structure of the Clang AST

The Clang AST A Tutorial by Manuel Klimek You'll learn: 1. The basic structure of the Clang AST

The Clang AST A Tutorial by Manuel Klimek You'll learn: 1. The basic structure of the Clang AST 2. How to navigate the AST 3. Tools to understand the AST 4. Interfaces to code against the AST (Tooling, AST matchers, etc) The Structure of the

602 views • 44 slides
www.studiestoday.com d] Stubs Stubs explain contents of row of a table. e] Body of the

www.studiestoday.com d] Stubs Stubs explain contents of row of a table. e] Body of the

Downloaded from WWW.STUDIESTODAY.COM Downloaded from WWW.STUDIESTODAY.COM Chapter 4: PRESENTATION OF DATA Important terms and concepts: 1. Tabulation Orderly arrangement of data in rows and columns. 2. Objectives of Tabulation: a]

570 views • 4 slides
I/O Bus and Interface Data Bus Addr Bus CPU Control Interface Interface Interface Interface

I/O Bus and Interface Data Bus Addr Bus CPU Control Interface Interface Interface Interface

I/O Bus and Interface Data Bus Addr Bus CPU Control Interface Interface Interface Interface Keyboard CD Hard Printer & or Disk Display DVD Flaxer Eli - Computer Architecture Ch 8 - 1 Example: 8254 DB(0..7) DB 8254 IOR RD

453 views • 3 slides
clang-format Automatic formatting for C++ (Daniel Jasper - djasper@google.com) Why? A

clang-format Automatic formatting for C++ (Daniel Jasper - djasper@google.com) Why? A

clang-format Automatic formatting for C++ (Daniel Jasper - djasper@google.com) Why? A consistent coding style is important Formatting is tedious Clang's source files contain ~25% whitespace characters Sema::NameClassification

511 views • 24 slides
Switching a Linux distributions main toolchain to LLVM/Clang Bernhard Bero

Switching a Linux distributions main toolchain to LLVM/Clang Bernhard Bero

Switching a Linux distributions main toolchain to LLVM/Clang Bernhard Bero Rosenkrnzer, OpenMandriva/LinDev EuroLLVM 2019 When and why did we do it? Made the decision and started the transition around the time of the clang 3.5

204 views • 18 slides
GCC/Clang Optimizations for Embedded Linux Khem Raj, Comcast Embedded Linux Conference &

GCC/Clang Optimizations for Embedded Linux Khem Raj, Comcast Embedded Linux Conference &

GCC/Clang Optimizations for Embedded Linux Khem Raj, Comcast Embedded Linux Conference & OpenIOT summit Portland, OR Introduction To Clang Native compiler FrontEnd to LLVM Infrastructure Supports C/C++ and Objective-C The

517 views • 20 slides
Using Clang for fun and profit Examples from the Chromium project Hans Wennborg hwennborg (at)

Using Clang for fun and profit Examples from the Chromium project Hans Wennborg hwennborg (at)

Using Clang for fun and profit Examples from the Chromium project Hans Wennborg hwennborg (at) google.com GOTO Aarhus 2013 Outline Chromium Background Numbers Clang Background Error Messages Warnings Tools Conclusion Introducing

429 views • 27 slides
Implementing Classes in Java, using Documented Stubs Test-First Programming Check out

Implementing Classes in Java, using Documented Stubs Test-First Programming Check out

Implementing Classes in Java, using Documented Stubs Test-First Programming Check out BankAccount and WordGames from SVN UML? Primitive types vs. objects? Object references (the written HW)? Javadoc? Unit testing?

535 views • 30 slides
Structure-aware fuzzing for Clang and LLVM with libprotobuf-mutator Kostya Serebryany, Vitaly

Structure-aware fuzzing for Clang and LLVM with libprotobuf-mutator Kostya Serebryany, Vitaly

Structure-aware fuzzing for Clang and LLVM with libprotobuf-mutator Kostya Serebryany, Vitaly Buka, Matt Morehouse; Google October 2017 Agenda Fuzzing Fuzzing Clang/LLVM Fuzzing Clang/LLVM better (structure-aware)

914 views • 35 slides
Software Engineering and Architecture Test Stubs and Doubles getting the world under test

Software Engineering and Architecture Test Stubs and Doubles getting the world under test

Software Engineering and Architecture Test Stubs and Doubles getting the world under test control GammaTowns RateStrategy But how to test? How do I TDD it? Read system clock to etc. etc. determine if weekend CS, AU Henrik Brbak

1.08k views • 48 slides
Security Feature Parity: GCC and Clang Linux Plumbers Conference 2019 Kees Cook

Security Feature Parity: GCC and Clang Linux Plumbers Conference 2019 Kees Cook

Security Feature Parity: GCC and Clang Linux Plumbers Conference 2019 Kees Cook <keescook@chromium.org> https://outflux.net/slides/2019/lpc/gcc-clang.pdf old school security feature examples stack canaries: -fstack-protector-strong

552 views • 15 slides
Faster, Stronger C++ Analysis with the Clang Static Analyzer George Karpenkov, Apple Artem

Faster, Stronger C++ Analysis with the Clang Static Analyzer George Karpenkov, Apple Artem

Faster, Stronger C++ Analysis with the Clang Static Analyzer George Karpenkov, Apple Artem Dergachev, Apple Agenda Introduction to Clang Static Analyzer Using coverage-based iteration order Improved C++ constructor and destructor

789 views • 40 slides
Implementing Classes in Java, using Documented Stubs Test-First Programming Check out

Implementing Classes in Java, using Documented Stubs Test-First Programming Check out

Implementing Classes in Java, using Documented Stubs Test-First Programming Check out BankAccount and WordGames from SVN Encapsulation Java classes: Implementation details How To example Practice in WordG dGam

606 views • 26 slides
Here be dragons: Using clang/LLVM to build Android Presented by: Behan Webster (LLVMLinux

Here be dragons: Using clang/LLVM to build Android Presented by: Behan Webster (LLVMLinux

Here be dragons: Using clang/LLVM to build Android Presented by: Behan Webster (LLVMLinux project lead) Presentation Date: 2014.05.01 LLVMLinux project Clang/LLVM LLVM is a Toolchain Toolkit (libraries from which compilers and related

464 views • 33 slides
Component testing: stubs, drivers Often want to test individual parts of a program in

Component testing: stubs, drivers Often want to test individual parts of a program in

Component testing: stubs, drivers Often want to test individual parts of a program in isolation, possibly before the rest of the program has been developed May happen in team situations, were writing one part, someone else is writing

186 views • 4 slides
Documented Stubs, Test-First Programming Check out UnitTesting and WordGames from SVN Dont

Documented Stubs, Test-First Programming Check out UnitTesting and WordGames from SVN Dont

Unit Tests and Object References Implementing Classes in Java, using Documented Stubs, Test-First Programming Check out UnitTesting and WordGames from SVN Dont try to memorize the Java libraries Nearly 9000 classes and packages!

316 views • 20 slides
Generating Serialisation Code with Clang EURO-LLVM CONFERENCE 12 th April 2012 Wayne Palmer

Generating Serialisation Code with Clang EURO-LLVM CONFERENCE 12 th April 2012 Wayne Palmer

Generating Serialisation Code with Clang EURO-LLVM CONFERENCE 12 th April 2012 Wayne Palmer Generating Serialisation Code with Clang 1 12-Apr-2012 Generating Serialisation Code with Clang INTRODUCTION TO THE QUANTITATIVE ANALYTICS LIBRARY

402 views • 27 slides
Developing and Shipping LLVM and Clang with CMake The lesser of two evils Chris Bieneman IRC:

Developing and Shipping LLVM and Clang with CMake The lesser of two evils Chris Bieneman IRC:

Developing and Shipping LLVM and Clang with CMake The lesser of two evils Chris Bieneman IRC: beanz GitHub: llvm-beanz Agenda Transition from Autoconf to CMake Shipping LLVM & Clang Putting the Build System to Work Current

462 views • 31 slides
Interface Documents David Christian 11/20/17 Interface between CE and DAQ Interface

Interface Documents David Christian 11/20/17 Interface between CE and DAQ Interface

Interface Documents David Christian 11/20/17 Interface between CE and DAQ Interface documents will define the boundaries of responsibility between the various consortia. Project management (Steve Kettell) is pushing to get these drafted.

226 views • 4 slides

More recommend