Tokenization is breaking the raw text into small chunks. Tokenization breaks the raw text into words, sentences called tokens. These tokens help in understanding the context or developing the model for the NLP. The tokenization helps in interpreting the meaning of the text by analyzing the sequence of the words

• check and insert space
• split token
• check quotes.
• expand variables.
• define type
• add token

hash table I use dbj2 algorithm for hash env value

• hash -> to get the best index to save value on a hash table. Djb2.
• init and create a table for saving our env value.
• insert value.
• find value.
• delete value.
• print table.
• check leak and clear

• pwd
• cd
• export
• unset
• env
• exit

Every command will be in a structure that contains all of its info together. This will organize minishell structure and allow tokens to be grouped with all of its tokens, filenames, execve tables, etc.

->include
for headers file
-> lib
libft , gext_next_line,..
-> src
-->tools
-->utils
-->....
mina.c
MakeFile

some sourec

link1
link 2

list from google

creating parser that store commands in command_table and try to execute.
Later must add support for double/single qoute " ' , pipes | , redirect, env var $, etc.

this line when minishell->line pass and return only first word
exmaple
before :

ls -la

after

ls 

back only ls

Issue

when updating any external library it's not updated if use make re

expect:
when use make re all library update with last change

add readline library to docker for developing minishell

Now our shell works on any system. I update execute functions to update the cmd path every execute

Ok, everything is fine, but if written
ls -la | grep Makefile.

msh->command_table[0] => its OK
msh->command_table[1] => no return

I think the issue is output from msh->command_table[0] . It's not showing for msh->command_table[1] for that's still waiting

this feature will be like