byte type -> Tokenizer - > Lexer -> Parser

need to write or replicate MyBasic script in C# and write an article...

Basic Types

1. Byte Struct

Represents an 8-bit unsigned integer.

public readonly struct Byte : IComparable, IComparable <byte >, IConvertible, IEquatable <byte >, ISpanFormattable

Inheritance: Object -> ValueType ->Byte

2. Integral numeric types (C# reference)

The integral numeric types represent integer numbers. All integral numeric types are value types. They're also simple types and can be initialized with literals. All integral numeric types support arithmetic, bitwise logical, comparison, and equality operators.

3. Floating-point numeric types (C# reference)

The floating-point numeric types represent real numbers. All floating-point numeric types are value types. They are also simple types and can be initialized with literals. All floating-point numeric types support arithmetic, comparison, and equality operators.

4. Structure types (C# reference)

A structure type (or struct type) is a value type that can encapsulate data and related functionality. You use the struct keyword to define a structure type:

5. char (C# reference)

The char type keyword is an alias for the .NET System.Char structure type that represents a Unicode UTF-16 character.

6. Enumeration types (C# reference)

An enumeration type (or enum type) is a value type defined by a set of named constants of the underlying integral numeric type. To define an enumeration type, use the enum keyword and specify the names of enum members:

tokenizer class

7. A List of Useful Articles from MSDN Magazine

Stuff I've found useful and interesting

8. Free BASIC Compilers and Interpreters

The term BASIC, an acronym for Beginner's All-purpose Symbolic Instruction Code, actually describes a whole plethora of computer languages, not all of which are actually compatible with each other. On many home computers, the earliest implementations of the BASIC language was as a very simple line oriented interpreter. The simplicity of the original language made it easy for beginners to learn programming, giving rise to a whole generation of programmers who cut their teeth on this language (although it must be said that the language's simplicity also led to a host of bad programming practices as programmers tried to work around the language's limitations). Today, however, the language has grown very large and is split into a number of different dialects (many of which bear little resemblance to the original BASIC language) and includes support for many modern programming paradigms like structured programming (using functions or procedures) and object-oriented programming, etc.

9. Chipmunk Basic

Chipmunk Basic is an interpreter for the BASIC Programming Language. It runs on multiple OS platforms, and is reasonably fast for a pure interpreter. Chipmunk Basic presents a traditional (vintage) terminal-command-line programming environment, and supports a simple, old-fashioned, and easy-to-learn dialect of the Basic Programming Language. (Line numbers are required when using the built-in command-line console, but are not required in Basic programs written using an external text editor.) The language also supports a few advanced extensions. Free for educational and personal use.

10. Tokenizer - Data Extraction Library

Tokenizer is a .NET Standard and .NET Framework library that allows you to extract information from text using predefined patterns. Tokens embedded within patterns are extracted, validated and transformed before being returned as a strongly typed object:

11. How to Build a Tokenizer/Lexer Generator in C#

Build a full featured tokenizer generator in C#

12. C# tokenizer

good list

Parser Tools - Must Read

13. Parsing In C#: Tools And Libraries

This is an article similar to a previous one we wrote: Parsing in Java, so the introduction is the same. Skip to chapter 3 if you have already read it.

good gateway...

14. MyBasic - A Custom-BASIC language interpreter written in C++

A Custom-BASIC language interpreter written in C++

15. String Tokenizer class

A customizable string tokenizer.

16. Bird Programming Language: Part 1

A new general purpose language that aims to be fast, high level and simple to use.

17. Irony - .NET Compiler Construction Kit

Introduction to Irony - a new technology of parser/compiler construction for .NET.

18. Writing Your First Domain Specific Language, Part 1 of 2

A guide to writing a compiler in .NET for beginners, using Irony.

19. Script.NET a language for embedding scripting functionality into CLR Applications

Scripting language for .NET Framework 2.0. Supports native .NET Types, Dynamic casting, Meta programming.

20. 68 Resources To Help You To Create Programming Languages

68 Resources To Help You To Create Programming Languages

21. The ANTLR Mega Tutorial

Parsers are powerful tools and using ANTLR you could write all sort of parsers, usable from many different languages.

22. Learn to Build Professional Parsers

Learn everything you need to parse, starting from scratch: you can start building a parser today. Nobody dreams of building a parser. You need a parser for something. We can help get you there faster.

23. The complete guide to (external) Domain Specific Languages

This guide will show you:

1. the what: after a definition we will look into 19 examples of DSLs
2. the why: what are the concrete benefits you can achieve using DSLs
3. the how: we will discuss the different ways to build a DSLs and what are the success factors