Nigel
/
BarinkOS
1
0
Fork 0
Code Issues 1 Pull Requests 2 Releases Activity

Merge into main the new state of the operating system/kernel #1

Open
Nigel wants to merge 120 commits from dev into main
pull from: dev
merge into: Nigel:main
Conversation 0 Commits 120 Files Changed 146
Nigel commented 2023-10-28 18:48:17 +00:00
Owner

A long time has passed since Main was updated. Its time it gets updated to the latest iteration of the Operating system/Kernel.

A long time has passed since Main was updated. Its time it gets updated to the latest iteration of the Operating system/Kernel.
Nigel self-assigned this 2023-10-28 18:48:17 +00:00
Nigel added 120 commits 2023-10-28 18:48:24 +00:00
2621399349 Small code fix up 
- Moved memcmp function to temporary libc/mem.h
- I/O functions are inlined
- ATA_DEVICE read function won't print the 512 bytes by default
72008b0a7a Find RSD Table in early BIOS memory 
Adding functions and structures to read the RSD.
fb2a19e11d FAT16 structures read from disk using ATA. 
The proper reading of folders and files is not yet implemented. Although
it is close.
b8d75dddae Moving lots into seperate folders to cleanup the project structure 
- Drivers have now gotten Category folders
- RSDP is now called ACPI
- Ports folders is now called Serial to show that its a serial driver
- Paging assembly definition is moved to the memory folder
- VGA folder has moved into the drivers
- Patched the makefile and include statements to reflect the changes
	in the project structure
19b9cfe908 Reading files from disk 
- Modified makefile to start the virtualbox vm on `make run`
- Listing files in rootdirectory with their properties and
	content
0d8ef065e0 Interactive supervisor mode 
To ease the pain of debuggin I can now interact with the system through a
very simplistic terminal. Hopefully things can be tested more easily by activating
the piece through a simple command. The max characters for a command is 10.

To achieve this I have had to make the following changes.
- Changed IRQ to update a global status variable
- Added a standalone keyboard driver with getKey functions
- Changed the main kernel loop to display a prompt
- Added a strncmp function to the clib/string file
7496299761 Basic Intel Exceptions 
Any interrupt thrown for any Intel defined Exception is not only being caught but
displays an appropriate message to the screen.

Changes made in src/kernel/idt/idt.cpp
97606dbf71 Clean up of debugging logs and new commands. 
As this project grows it becomes important to keep things properly organised.
In this commit I've put some effort into making the kernel.cpp file more consise and thus improve its
readability.
Certain parts of the code have gotten their own definition file where before it
was only a header file.

- Moving the Supervisor Terminal into its own definition file.
- Subtracting debugging messages with preprocessor ifdef's
- Time and Date is now not just a header but has its own proper definition file
- Banner is displayed when booting up
- Terminal has a couple new commands

	Commmand		Description
	=================|||||===================================================
	DATE (was TIME)		Displays the curren time, date and ticks
	VERSION			Displays system version information
	MEMORY			Displays memory information
b4cff3e667 Basic block allocation for physical memory allocation. 
- 1 block = 4096 bytes : because this will make page fault handling possibly
somewhat easier

- 1 byte in the bitmap = 8 blocks of physical memory

unsure if the allocation is perfect ... guess i'll find out some day if this is actually correct.

The bitmap needs 16kb to keep track of 2gb of physical memory. Seems a decent percentage to me.
2e59e6593e Add proper Physical memory management to this branch 
to ensure it doesn't get too out of date

We can now run the FAT command to demo reading out the FAT16 filesystem,
however this will cause the need for a reboot as after this command. We are FOR NOW
not able to put in any new commands
9172da075a Added identity paging basics 
Followed wiki.osdev.org/Setting_Up_Paging
388ac8e7f9 Added checks to be sure paging is actually enabled on the cpu. 
- Made a special assembly file to put CPU check function in. E.G. functions to get the state of
	specific registers

In this case I have created a simple assembly function to get the contents of the CR0 register.
With the help of the c++ preprocessor the value can then be used to check if certains bits are set.
For example to check if the PG (paging) bit is set, indicating that paging is enabled for the
processor.
3b3e2597a1 Restructering Kernel folder before moving to higher half kernel 
The boot up process will be changed somewhat dramatically, therefor a
restructering of the kernel seems as a good starting point.
bbfea39c23 Fixing include paths for new structure 
Removed non-sensical libc folder from project
7d6c823d79 Basic Launch of Higher half kernel 
We now can launch the kernel at 0xC0000000 (or 3 GiB mark) with paging enabled.
A lot of early main is currently not executed to keep debugging as simple as possible
during the initial testing of higher half kernel loading.

A lot of the implementation is straight from wiki.osdev.org/Higher_Half_x86_Bare_Bones. Thanks to all the folks
who keep that wiki updated, its really resourceful.
d280aa0584 Page faults and protetion faults will now hang with a helpful message 
to explain what is going on.

I removed previously set barriers from the code to load
the kernel further.
9436e6e033 End of the day cleanup. 
* Added symbol files to .gitignore
* Improved text in #PG and #GP handlers
* Added the printing of the multiboot structure address and the magic value
* Added page fault screenshot to readme
e70f56a005 Improving the memory mapping boot code 
Removed the need to map the extra MBI structure in as a seperate pagetable
Renaming / Restructuring the memory folder
0f0fc9f252 Adding a skeleton for the memory management code 
Moved the PMM away from being object orientated as it is just plain annoying
renamed src folder to source
Set timeout to 5 seconds in the grub config
5051b8903c Divided the kernel into seperate distinct phases 
The first stage after GRUB will be Pre-Kernel. This stage will organize the
information we receive from the bootloader. (in our case that will be grub)

The second stage is for now called early_main. The program will at this
point already be running in virtual higher-half / higher-quarter address space.
The goal of the second stage is to set up the kernel in such a way that we are
ready to jump in to usermode.

The third stage is for now called kernel_main. This stage will jump us into
usermode and load the startup programs.

- Added a GRUB entry for tests
- Started writing the pre-kernel stage
- Removed knowledge of multiboot from early_main
- Edited the linkerscript to link variables in pre-kernel to
	lower address space. ( from 1MB and up)
a5e7fdd07e KERNEL: Physical Page Frame allocation 
Rewriting the setup to allow for physical memory allocation again to work.
a70ae5ca31 KERNEL: Mapping the bios region ( below 1Mib) 
Keyboard.h: remove the incorrect use of typedef

PhysicalMemoryManager.cpp:
Map the Bios region as used. This prevents us from allocation the area used by the bios
9893a0bd17 KERNEL: Cleanup 
Removing quite a few unnecessary parts.
13e9beea79 KERNEL: Implementing VMM & cleaning up 
Folders now are alll lower case

Started working on the implementation of the Virtual memory manager. Implemented allocate and free page funtionality for as far as I can atm.

Implemented the
01fcb0aa15 KERNEL: Improved Physical memory allocation code / Code refactor 
* Moved tests to a different folder
* Adjusted the memory map address locations
* Improved readability of `kernel.cpp`
656ca0baa8 KERNEL: Pre-kernel sets up the physical memory manager. 
* BUG: allocated blocks is possibly incorrect!
* prekernel no longer gets compiled as being in physical memory
891085e151 Successfully able to create a disk-image file 
- Created a scripts folder
- Written instructions on how to create the disk image
- Working on a python build script that executes all other scripts

The scripts folder should contain scripts to build a full installation of
our operating system. Scripts like creating a filesystem should be found here
749f2aa492 Updating folders name's (1) 
This should help merging into dev branch
27e99fe4f2 Merged FAT16 into Dev 
Hopefully with success
520104a43a Moved reading file from disk to its own super visor terminal command 
- Updated gdt assembly
- Updated Interrupt service request handlers
- Improved virtual memory manager
- NOTE: we're dependent on identity mappings for the heap to work
1f90a5d862 Starting to move towards proper HAL and ring3 
- slight clean up of PCI driver
- Added TaskSegment header
- Rename some folders
c9a036bfbb Ring 3 ready 
- Fixed issue with setting up the Task Segment Register
490529099b Started implementing the virtual file system 
- The FAT command is no longer available
- At Startup the FileSystem initialise funciton
is called, it should execute the same code as the FAT command did.
- ACPI::initialise is commented out because it causes a Exception
37542b736f Remove cpu.h and cpu.cpp in favor of i386/processor.[h|cpp] 
Moving enable protected Mode to processor class
94a2de3847 Started on path resolution algorithm 
- The algorithm will work once I am of better mind to deal with
raw C strings
- The resolution should look at each entry divided by '/'.
  if the entry is not there then we can quit early, however for
now I am mostly concerned with getting the names of directory entries
we would need to look for.
b07b4f0d38 Moving certain aspects into their own static library 
Problem:
	As our kernel grows we need more complex datastructures and functions these would come from
	the standard C/C++ library with normal programs.
	The kernel is a freestanding programme and has no access to standard libraries.

Solution:
	We build a mini version of the standard C/C++ library which will contain the
	datastructures and functions we want. This library can then be statically linked
	into our kernel binary.

	Making it a statically linked library also gives more structure to the project.
	Keeping these random functions and datastructures in the kernel just clutters the
	kernel source code with less relevant source code.
dea8ab7d71 Improved build system 
Added new entries to .gitignore
Moved away from source directory as central spot for all source code
81f7351fe6 Created a few shell scripts to update and create an build of the Kernel/Operating System. 
A python script can be run to run the scripts in the correct order and immediatly try the build.
50bf952a49 Basic idea's are created for the storage solution 
- Added boot device info parsing to the kernel
- Added a pointer in the kernel to our pre-kernel BootInfo structure
- Created a layout for the FAT driver
- Created a layout for the virtual filesystem
- Separated IDE driver from the basic atapio driver.
	This will ensure we are not using one or the other
- The create_harddrive shell script will now actually build a harddrive image of
	the kernel
- The virtual filesystem initializes and creates a filesystem structure
	for every FAT16 partition in the master boot record
a77621faf5 Shellscript improvement plus FAT driver implementations 
- Improved the run bash script to exit when an error occurs in one of the sub tasks
- Wrote basic FAT16 functions that should give enough information to properly implement the rest of the driver
- FAT structure namings are now in accordence with the microsoft spec of March 2005
644ff5b1f5 Adding subdir functionality 
Added FAT16 driver ability to list subdir entries
Removed structure of FAT32 (we won't be using it anytime soon)
e6901f0526 We can now open and read files on the harddisk through a messy virtual filesystem 
The uri has to contain 8.3 filenames for now as I have not yet figured out
how to convert from that to regular filenaming for the name comparison.

reading files is still limited to 1 sector
5781f730d9 Implemented the basis for syscalls 
A software interrupt with vector 0x50 will cause a syscall to start executing.
The EAX register will hold the syscall_num.
Other registers and the stack can be used to hold further arguments.
2522492835 Couple of small changes 
* Commented out the map page function call to handle page not present
* Mapped the ACPI_RECLAIMABLE_MEMORY
* Set VBE to false when VBE is not initialized by the bootloader
Nigel added the
PR
 label 2023-10-28 18:52:44 +00:00
Nigel changed title from WIP: Merge into main the new state of the operating system/kernel to Merge into main the new state of the operating system/kernel 2023-10-28 18:53:00 +00:00
This pull request can be merged automatically.
You are not authorized to merge this pull request.
You can also view command line instructions.

Step 1:

From your project repository, check out a new branch and test the changes.
git checkout -b dev main
git pull origin dev

Step 2:

Merge the changes and update on Gitea.
git checkout main
git merge --no-ff dev
git push origin main
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels   
bug

Something is not working   
duplicate

This issue or pull request already exists   
enhancement

New feature   
help wanted

Need some help   
invalid

Something is wrong
  
points
1
   
points
2
  
PR
   
question

More information is needed   
Release
   
wontfix

This won't be fixed
No Label
bug
duplicate
enhancement
help wanted
invalid
points
1
points
2
PR
question
Release
wontfix
Milestone
Clear milestone
No items
No Milestone
Assignees
Clear assignees
No Assignees
Nigel
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: Nigel/BarinkOS#1
There is no content yet.
Delete Branch "dev"

Deleting a branch is permanent. Although the deleted branch may exist for a short time before cleaning up, in most cases it CANNOT be undone. Continue?