dotnet / dotnet/fsharp

`Tracking` - Testing - move fsharpqa tests to new framework

Open
#12,823 0 comments 1 reaction 0 assignees View on GitHub
Plan Tracking
Dominant language
F#
Stars
4.3k
Forks
876
Avg merge
4d 11h
Merged PRs (30d)
131

Description

There are a gazillion tests in fsharpQA - I will try to do them a directory at a time.
It should be noted that currently the fsharpqa tests runs only on desktop, with only a retail compiler/compilerservice. Part of this process includes extending the test to run net472/netcore, as well as debug and release. The existing framework will be updated to accommodate the additional scenarios as part of this process.

- Also note, that desktop ildasm with desktop pdbs include source code position information which identifies sequence point information. We will need to instead use sp information from portable pdb files. @vzarytovskii , is currently updating the test infra to handle this.

- [ ] Source\Common
- [ ] Source\CompilerOptions
- [ ] Source\Conformance
- [ ] Source\Diagnostics
- [ ] Source\EntryPoint
- [ ] Source\Import
- [ ] Source\InteractiveSession
- [ ] Source\Libraries
- [ ] Source\Misc
- [ ] Source\MultiTargeting
- [ ] Source\Optimizations
- [ ] Source\Stress
- [ ] Source\TemplatesAndSnippets
- [x] Source\CodeGen
- [x] Source\CodeGen\EmittedIL
- [x] Source\CodeGen\StringEncoding
- [x] Source\CodeGen\Structure
- [x] Source\CodeGen\EmittedIL\AsyncExpressionStepping
- [x] Source\CodeGen\EmittedIL\AttributeTargets
- [x] Source\CodeGen\EmittedIL\CCtorDUWithMember
- [x] Source\CodeGen\EmittedIL\CompiledNameAttribute
- [x] Source\CodeGen\EmittedIL\ComputationExpressions
- [x] Source\CodeGen\EmittedIL\DoNotBoxStruct
- [x] Source\CodeGen\EmittedIL\GeneratedIterators
- [x] Source\CodeGen\EmittedIL\InequalityComparison
- [x] Source\CodeGen\EmittedIL\ListExpressionStepping
- [x] Source\CodeGen\EmittedIL\MethodImplAttribute
- [x] Source\CodeGen\EmittedIL\Misc
- [x] Source\CodeGen\EmittedIL\Operators
- [x] Source\CodeGen\EmittedIL\QueryExpressionStepping
- [x] Source\CodeGen\EmittedIL\SeqExpressionStepping
- [x] Source\CodeGen\EmittedIL\SeqExpressionTailCalls
- [x] Source\CodeGen\EmittedIL\SerializableAttribute
- [x] Source\CodeGen\EmittedIL\StaticInit
- [x] Source\CodeGen\EmittedIL\SteppingMatch
- [x] Source\CodeGen\EmittedIL\TestFunctions
- [x] Source\CodeGen\EmittedIL\Tuples
- [ ] Source\CompilerOptions\fsc
- [ ] Source\CompilerOptions\fsi
- [ ] Source\CompilerOptions\fsc\checked
- [ ] Source\CompilerOptions\fsc\cliversion
- [ ] Source\CompilerOptions\fsc\codepage
- [ ] Source\CompilerOptions\fsc\crossoptimize
- [ ] Source\CompilerOptions\fsc\debug
- [ ] Source\CompilerOptions\fsc\determinism
- [ ] Source\CompilerOptions\fsc\dumpAllCommandLineOptions
- [ ] Source\CompilerOptions\fsc\flaterrors
- [ ] Source\CompilerOptions\fsc\gccerrors
- [ ] Source\CompilerOptions\fsc\help
- [ ] Source\CompilerOptions\fsc\highentropyva
- [ ] Source\CompilerOptions\fsc\invalid
- [ ] Source\CompilerOptions\fsc\langversion
- [ ] Source\CompilerOptions\fsc\lib
- [ ] Source\CompilerOptions\fsc\noframework
- [ ] Source\CompilerOptions\fsc\nologo
- [ ] Source\CompilerOptions\fsc\optimize
- [ ] Source\CompilerOptions\fsc\out
- [ ] Source\CompilerOptions\fsc\pdb
- [ ] Source\CompilerOptions\fsc\platform
- [ ] Source\CompilerOptions\fsc\reference
- [ ] Source\CompilerOptions\fsc\Removed
- [ ] Source\CompilerOptions\fsc\responsefile
- [ ] Source\CompilerOptions\fsc\simpleresolution
- [ ] Source\CompilerOptions\fsc\standalone
- [ ] Source\CompilerOptions\fsc\staticlink
- [ ] Source\CompilerOptions\fsc\subsystemversion
- [ ] Source\CompilerOptions\fsc\tailcalls
- [ ] Source\CompilerOptions\fsc\target
- [ ] Source\CompilerOptions\fsc\times
- [ ] Source\CompilerOptions\fsc\tokenize
- [ ] Source\CompilerOptions\fsc\win32res
- [ ] Source\CompilerOptions\fsc\determinism\PathMap1
- [ ] Source\CompilerOptions\fsc\determinism\PathMap2
- [ ] Source\CompilerOptions\fsc\lib\Folder1
- [ ] Source\CompilerOptions\fsc\lib\Folder2
- [ ] Source\CompilerOptions\fsc\lib\Folder3
- [ ] Source\CompilerOptions\fsc\lib\Folder3\Folder3a
- [ ] Source\CompilerOptions\fsi\arguments
- [ ] Source\CompilerOptions\fsi\exename
- [ ] Source\CompilerOptions\fsi\help
- [ ] Source\CompilerOptions\fsi\highentropyva
- [ ] Source\CompilerOptions\fsi\langversion
- [ ] Source\CompilerOptions\fsi\nologo
- [ ] Source\CompilerOptions\fsi\subsystemversion
- [ ] Source\CompilerOptions\fsi\times
- [x] Source\Conformance\BasicGrammarElements
- [x] Source\Conformance\BasicTypeAndModuleDefinitions
- [ ] Source\Conformance\DeclarationElements
- [ ] Source\Conformance\Expressions
- [ ] Source\Conformance\ImplementationFilesAndSignatureFiles
- [ ] Source\Conformance\InferenceProcedures
- [ ] Source\Conformance\LexicalAnalysis
- [ ] Source\Conformance\LexicalFiltering
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions
- [ ] Source\Conformance\PatternMatching
- [ ] Source\Conformance\Signatures
- [ ] Source\Conformance\SpecialAttributesAndTypes
- [ ] Source\Conformance\StructFieldEqualityComparison
- [ ] Source\Conformance\TypeForwarding
- [ ] Source\Conformance\TypesAndTypeConstraints
- [ ] Source\Conformance\UnitsOfMeasure
- [ ] Source\Conformance\BasicGrammarElements\OperatorNames
- [ ] Source\Conformance\BasicGrammarElements\PrecedenceAndOperators
- [x] Source\Conformance\BasicTypeAndModuleDefinitions\ExceptionDefinitions
- [x] Source\Conformance\BasicTypeAndModuleDefinitions\GeneratedEqualityHashingComparison
- [x] Source\Conformance\BasicTypeAndModuleDefinitions\ModuleDefinitions
- [x] Source\Conformance\BasicTypeAndModuleDefinitions\NamespaceDeclGroups
- [x] Source\Conformance\BasicTypeAndModuleDefinitions\NullRepresentations
- [ ] Source\Conformance\BasicTypeAndModuleDefinitions\RecordTypes
- [ ] Source\Conformance\BasicTypeAndModuleDefinitions\TypeAbbreviations
- [ ] Source\Conformance\BasicTypeAndModuleDefinitions\UnionTypes
- [ ] Source\Conformance\BasicTypeAndModuleDefinitions\GeneratedEqualityHashingComparison\Attributes
- [ ] Source\Conformance\BasicTypeAndModuleDefinitions\GeneratedEqualityHashingComparison\Basic
- [ ] Source\Conformance\BasicTypeAndModuleDefinitions\GeneratedEqualityHashingComparison\IComparison
- [ ] Source\Conformance\BasicTypeAndModuleDefinitions\GeneratedEqualityHashingComparison\Attributes\Diags
- [ ] Source\Conformance\BasicTypeAndModuleDefinitions\GeneratedEqualityHashingComparison\Attributes\Legacy
- [ ] Source\Conformance\BasicTypeAndModuleDefinitions\GeneratedEqualityHashingComparison\Attributes\New
- [ ] Source\Conformance\DeclarationElements\AccessibilityAnnotations
- [ ] Source\Conformance\DeclarationElements\CustomAttributes
- [ ] Source\Conformance\DeclarationElements\Events
- [ ] Source\Conformance\DeclarationElements\FieldMembers
- [ ] Source\Conformance\DeclarationElements\ImportDeclarations
- [ ] Source\Conformance\DeclarationElements\InterfaceSpecificationsAndImplementations
- [ ] Source\Conformance\DeclarationElements\LetBindings
- [ ] Source\Conformance\DeclarationElements\MemberDefinitions
- [ ] Source\Conformance\DeclarationElements\ModuleAbbreviations
- [ ] Source\Conformance\DeclarationElements\ObjectConstructors
- [ ] Source\Conformance\DeclarationElements\P-invokeDeclarations
- [ ] Source\Conformance\DeclarationElements\AccessibilityAnnotations\basic
- [ ] Source\Conformance\DeclarationElements\AccessibilityAnnotations\OnOverridesAndIFaceImpl
- [ ] Source\Conformance\DeclarationElements\AccessibilityAnnotations\OnTypeMembers
- [ ] Source\Conformance\DeclarationElements\AccessibilityAnnotations\PermittedLocations
- [ ] Source\Conformance\DeclarationElements\CustomAttributes\ArgumentsOfAllTypes
- [ ] Source\Conformance\DeclarationElements\CustomAttributes\AttributeInheritance
- [ ] Source\Conformance\DeclarationElements\CustomAttributes\AttributeUsage
- [ ] Source\Conformance\DeclarationElements\CustomAttributes\Basic
- [ ] Source\Conformance\DeclarationElements\CustomAttributes\ImportedAttributes
- [ ] Source\Conformance\DeclarationElements\CustomAttributes\ArgumentsOfAllTypes\Generator
- [ ] Source\Conformance\DeclarationElements\Events\basic
- [ ] Source\Conformance\DeclarationElements\LetBindings\ActivePatternBindings
- [ ] Source\Conformance\DeclarationElements\LetBindings\Basic
- [ ] Source\Conformance\DeclarationElements\LetBindings\ExplicitTypeParameters
- [ ] Source\Conformance\DeclarationElements\LetBindings\TypeFunctions
- [ ] Source\Conformance\DeclarationElements\MemberDefinitions\ImplementingDispatchSlots
- [ ] Source\Conformance\DeclarationElements\MemberDefinitions\MethodsAndProperties
- [ ] Source\Conformance\DeclarationElements\MemberDefinitions\NamedArguments
- [ ] Source\Conformance\DeclarationElements\MemberDefinitions\OptionalArguments
- [ ] Source\Conformance\DeclarationElements\MemberDefinitions\OptionalDefaultParameterValueArguments
- [ ] Source\Conformance\DeclarationElements\MemberDefinitions\OverloadingMembers
- [ ] Source\Conformance\Expressions\ApplicationExpressions
- [ ] Source\Conformance\Expressions\BindingExpressions
- [ ] Source\Conformance\Expressions\ConstantExpressions
- [ ] Source\Conformance\Expressions\ControlFlowExpressions
- [ ] Source\Conformance\Expressions\DataExpressions
- [ ] Source\Conformance\Expressions\ElaborationAndElaboratedExpressions
- [ ] Source\Conformance\Expressions\EvaluationAndValues
- [ ] Source\Conformance\Expressions\EvaluationOfElaboratedForms
- [ ] Source\Conformance\Expressions\ExpressionQuotations
- [ ] Source\Conformance\Expressions\SomeCheckingAndInferenceTerminology
- [ ] Source\Conformance\Expressions\SyntacticSugar
- [ ] Source\Conformance\Expressions\SyntacticSugarAndAmbiguities
- [ ] Source\Conformance\Expressions\Type-relatedExpressions
- [ ] Source\Conformance\Expressions\ApplicationExpressions\Assertion
- [ ] Source\Conformance\Expressions\ApplicationExpressions\BasicApplication
- [ ] Source\Conformance\Expressions\ApplicationExpressions\ObjectConstruction
- [ ] Source\Conformance\Expressions\BindingExpressions\Binding
- [ ] Source\Conformance\Expressions\ControlFlowExpressions\Assertion
- [ ] Source\Conformance\Expressions\ControlFlowExpressions\Conditional
- [ ] Source\Conformance\Expressions\ControlFlowExpressions\ParenthesizedAndBlock
- [ ] Source\Conformance\Expressions\ControlFlowExpressions\PatternMatching
- [ ] Source\Conformance\Expressions\ControlFlowExpressions\SequenceIteration
- [ ] Source\Conformance\Expressions\ControlFlowExpressions\SequentialExecution
- [ ] Source\Conformance\Expressions\ControlFlowExpressions\SimpleFor
- [ ] Source\Conformance\Expressions\ControlFlowExpressions\TryFinally
- [ ] Source\Conformance\Expressions\ControlFlowExpressions\TryWith
- [ ] Source\Conformance\Expressions\ControlFlowExpressions\While
- [ ] Source\Conformance\Expressions\DataExpressions\AddressOf
- [ ] Source\Conformance\Expressions\DataExpressions\ComputationExpressions
- [ ] Source\Conformance\Expressions\DataExpressions\NameOf
- [ ] Source\Conformance\Expressions\DataExpressions\ObjectExpressions
- [ ] Source\Conformance\Expressions\DataExpressions\QueryExpressions
- [ ] Source\Conformance\Expressions\DataExpressions\RangeExpressions
- [ ] Source\Conformance\Expressions\DataExpressions\SequenceExpressions
- [ ] Source\Conformance\Expressions\DataExpressions\Simple
- [ ] Source\Conformance\Expressions\DataExpressions\TupleExpressions
- [ ] Source\Conformance\Expressions\DataExpressions\SequenceExpressions\version46
- [ ] Source\Conformance\Expressions\DataExpressions\SequenceExpressions\version47
- [ ] Source\Conformance\Expressions\ExpressionQuotations\Baselines
- [ ] Source\Conformance\Expressions\ExpressionQuotations\Regressions
- [ ] Source\Conformance\ImplementationFilesAndSignatureFiles\CheckingOfImplementationFiles
- [ ] Source\Conformance\ImplementationFilesAndSignatureFiles\InitializationSemanticsForImplementationFiles
- [ ] Source\Conformance\ImplementationFilesAndSignatureFiles\NamespacesFragmentsAndImplementationFiles
- [ ] Source\Conformance\ImplementationFilesAndSignatureFiles\SignatureFiles
- [ ] Source\Conformance\ImplementationFilesAndSignatureFiles\NamespacesFragmentsAndImplementationFiles\basic
- [ ] Source\Conformance\ImplementationFilesAndSignatureFiles\NamespacesFragmentsAndImplementationFiles\global
- [ ] Source\Conformance\InferenceProcedures\ByrefSafetyAnalysis
- [ ] Source\Conformance\InferenceProcedures\ConstraintSolving
- [ ] Source\Conformance\InferenceProcedures\DispatchSlotChecking
- [ ] Source\Conformance\InferenceProcedures\DispatchSlotInference
- [ ] Source\Conformance\InferenceProcedures\FunctionApplicationResolution
- [ ] Source\Conformance\InferenceProcedures\Generalization
- [ ] Source\Conformance\InferenceProcedures\MethodApplicationResolution
- [ ] Source\Conformance\InferenceProcedures\NameResolution
- [ ] Source\Conformance\InferenceProcedures\RecursiveSafetyAnalysis
- [ ] Source\Conformance\InferenceProcedures\ResolvingApplicationExpressions
- [ ] Source\Conformance\InferenceProcedures\TypeInference
- [ ] Source\Conformance\InferenceProcedures\WellFormednessChecking
- [ ] Source\Conformance\InferenceProcedures\NameResolution\AutoOpen
- [ ] Source\Conformance\InferenceProcedures\NameResolution\Misc
- [ ] Source\Conformance\InferenceProcedures\NameResolution\RequireQualifiedAccess
- [ ] Source\Conformance\LexicalAnalysis\Comments
- [ ] Source\Conformance\LexicalAnalysis\ConditionalCompilation
- [ ] Source\Conformance\LexicalAnalysis\Directives
- [ ] Source\Conformance\LexicalAnalysis\HiddenTokens
- [ ] Source\Conformance\LexicalAnalysis\IdentifierReplacements
- [ ] Source\Conformance\LexicalAnalysis\IdentifiersAndKeywords
- [ ] Source\Conformance\LexicalAnalysis\LineDirectives
- [ ] Source\Conformance\LexicalAnalysis\NumericLiterals
- [ ] Source\Conformance\LexicalAnalysis\Shift
- [ ] Source\Conformance\LexicalAnalysis\StringsAndCharacters
- [ ] Source\Conformance\LexicalAnalysis\SymbolicKeywords
- [ ] Source\Conformance\LexicalAnalysis\SymbolicOperators
- [ ] Source\Conformance\LexicalAnalysis\Whitespace
- [ ] Source\Conformance\LexicalAnalysis\Shift\Generics
- [ ] Source\Conformance\LexicalFiltering\Basic
- [ ] Source\Conformance\LexicalFiltering\HashLight
- [ ] Source\Conformance\LexicalFiltering\HighPrecedenceApplication
- [ ] Source\Conformance\LexicalFiltering\LexicalAnalysisOfTypeApplications
- [ ] Source\Conformance\LexicalFiltering\Basic\ByExample
- [ ] Source\Conformance\LexicalFiltering\Basic\OffsideExceptions
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\AbstractMembers
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\DelegateTypes
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\EnumTypes
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\InterfaceTypes
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\StructTypes
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\TypeExtensions
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\TypeKindInference
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\AsDeclarations
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\AutoProperties
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\ExplicitFields
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\ExplicitObjectConstructors
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\ImplicitObjectConstructors
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\InheritsDeclarations
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\LetDoDeclarations
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\MemberDeclarations
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\Misc
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\StaticLetDoDeclarations
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\ValueRestriction
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\TypeExtensions\basic
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\TypeExtensions\intrinsic
- [ ] Source\Conformance\ObjectOrientedTypeDefinitions\TypeExtensions\optional
- [ ] Source\Conformance\PatternMatching\And
- [ ] Source\Conformance\PatternMatching\Array
- [ ] Source\Conformance\PatternMatching\As
- [ ] Source\Conformance\PatternMatching\ConsList
- [ ] Source\Conformance\PatternMatching\DynamicTypeTest
- [ ] Source\Conformance\PatternMatching\Expression
- [ ] Source\Conformance\PatternMatching\Named
- [ ] Source\Conformance\PatternMatching\Null
- [ ] Source\Conformance\PatternMatching\Record
- [ ] Source\Conformance\PatternMatching\Simple
- [ ] Source\Conformance\PatternMatching\SimpleConstant
- [ ] Source\Conformance\PatternMatching\Tuple
- [ ] Source\Conformance\PatternMatching\TypeAnnotated
- [ ] Source\Conformance\PatternMatching\TypeConstraint
- [ ] Source\Conformance\PatternMatching\Union
- [ ] Source\Conformance\PatternMatching\Wildcard
- [ ] Source\Conformance\Signatures\SignatureConformance
- [ ] Source\Conformance\Signatures\SignatureTypes
- [ ] Source\Conformance\SpecialAttributesAndTypes\Imported
- [ ] Source\Conformance\SpecialAttributesAndTypes\Imported\CallerInfo
- [ ] Source\Conformance\SpecialAttributesAndTypes\Imported\System.ThreadStatic
- [ ] Source\Conformance\TypeForwarding\Class
- [ ] Source\Conformance\TypeForwarding\Cycle
- [ ] Source\Conformance\TypeForwarding\Delegate
- [ ] Source\Conformance\TypeForwarding\Interface
- [ ] Source\Conformance\TypeForwarding\Nested
- [ ] Source\Conformance\TypeForwarding\Struct
- [ ] Source\Conformance\TypesAndTypeConstraints\CheckingSyntacticTypes
- [ ] Source\Conformance\TypesAndTypeConstraints\LogicalPropertiesOfTypes
- [ ] Source\Conformance\TypesAndTypeConstraints\TypeConstraints
- [ ] Source\Conformance\TypesAndTypeConstraints\TypeParameterDefinitions
- [ ] Source\Conformance\UnitsOfMeasure\Basic
- [ ] Source\Conformance\UnitsOfMeasure\Bounds
- [ ] Source\Conformance\UnitsOfMeasure\Constants
- [ ] Source\Conformance\UnitsOfMeasure\Diagnostics
- [ ] Source\Conformance\UnitsOfMeasure\Operators
- [ ] Source\Conformance\UnitsOfMeasure\Parenthesis
- [ ] Source\Conformance\UnitsOfMeasure\Parsing
- [ ] Source\Conformance\UnitsOfMeasure\TypeChecker
- [ ] Source\Conformance\UnitsOfMeasure\WithOOP
- [ ] Source\Diagnostics\async
- [ ] Source\Diagnostics\General
- [ ] Source\Diagnostics\NONTERM
- [ ] Source\Diagnostics\ParsingAtEOF
- [ ] Source\InteractiveSession\Misc
- [ ] Source\InteractiveSession\Misc\aaa
- [ ] Source\InteractiveSession\Misc\ccc
- [ ] Source\InteractiveSession\Misc\GenericConstraintWoes
- [ ] Source\InteractiveSession\Misc\ScriptTest
- [ ] Source\InteractiveSession\Misc\UnknownDependencyManager
- [ ] Source\InteractiveSession\Misc\aaa\bbb
- [ ] Source\InteractiveSession\Misc\GenericConstraintWoes\issue2411
- [ ] Source\Libraries\Core
- [ ] Source\Libraries\Portable
- [ ] Source\Libraries\Core\NativeInterop
- [ ] Source\Libraries\Core\PartialTrust
- [ ] Source\Libraries\Core\NativeInterop\stackalloc
- [ ] Source\Misc\test
- [ ] Source\Optimizations\AssemblyBoundary
- [x] Source\Optimizations\ForLoop
- [x] Source\Optimizations\GenericComparison
- [x] Source\Optimizations\Inlining
- [ ]

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.