EOF Tracker

[marioevz]

Tasks

Beta Give feedback

1. Create a test spec type for the EOF container fixture format (Done)
2. Update exceptions.py to add the existing EOF exceptions to the Enum
3. Add automatic BlockchainTest and BlockchainHiveTest generation to the EOFTest spec.
4. Update or create a new class to be able to generate and parametrize EOF containers according to the latest spec
5. Port EIP3540
6. Port EIP3670
7. Port EIP4200
8. Port EIP4750
9. Port EIP5450

[marioevz]

Basic example of the test filler:

execution-spec-tests/tests/prague/eip3540_evm_object_format_v1/test_eof.py

Line 19 in 760a67e

@pytest.mark.parametrize(

This is not how all tests should be rewritten as this example barely takes any advantage of parameterization, but it's simply an example of usage of the EOFTest spec class.

[gumb0]

To summarize the current status of our existing tests:

1. https://github.com/ethereum/tests/tree/develop/src/EIPTestsFiller/StateTests/stEOF/stEIP3540
   https://github.com/ethereum/tests/tree/develop/src/EIPTestsFiller/StateTests/stEOF/stEIP4200
   https://github.com/ethereum/tests/tree/develop/src/EIPTestsFiller/StateTests/stEOF/stEIP4750
   https://github.com/ethereum/tests/tree/develop/src/EIPTestsFiller/StateTests/stEOF/stEIP5450

• These tests were written a while ago for Shanghai version of the spec, after that they were mostly only updated to keep them compatible with the later changes. We removed all tests testing EOF validation aspect and made validation tests from them (see below). I wouldn't expect these tests to cover all complexities of current version of EIPs-3540, 4200, 4750, 5450 (but they do pass with current spec)

2. EOF validation tests https://github.com/ethereum/tests/tree/develop/src/EOFTestsFiller

• These are partially hand-written (EIP* folders, also efExample and ori), and partially generated from evmone unit tests, which @winsvega merged recently as Copier tests (rest of ef* folders). I expect these tests to cover almost all aspects of validation reasonably well.

3. EOF state tests generated by evmone tests#1324

• State tests generated from evmone tests, these mostly test various aspects of contract creation (EOFCREATE, TXCREATE, InitcodeTransactions), new EXTCALL* instructions and some related execution aspects.

See also the list at https://github.com/ipsilon/eof/blob/main/spec/implementation_matrix.md#column-descriptions we try to keep it up to date.