Skip to content

Topic recognition #168

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 24 commits into
base: topic-recognition
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
091a26a
Initial commit
noam-mendelson Oct 13, 2023
aba7155
Add function to fetch image paths from directory
noam-mendelson Oct 13, 2023
8b8a46a
Add function to extract patient IDs and split data into train/ valida…
noam-mendelson Oct 13, 2023
5787edb
Create Dataset class for loading AD and NC images
noam-mendelson Oct 14, 2023
daf4d41
Data normalisation and augmentation for training
noam-mendelson Oct 15, 2023
8df3880
Organize CViT configuration parameters for clearer instantiation
noam-mendelson Oct 16, 2023
4a9770e
Outlining classes required for model and completion of MultiHeadSelfA…
noam-mendelson Oct 16, 2023
da51c0e
Populate TransformerBlock and ConvolutionalEmbedding modules
noam-mendelson Oct 16, 2023
833537f
Complete populating ConvolutionalEmbedding and ConvolutionalVisionTra…
noam-mendelson Oct 17, 2023
c96ce83
Update data transformations for sets
noam-mendelson Oct 18, 2023
2ca947d
Debugging and congiguration parameters updated
noam-mendelson Oct 19, 2023
b8e06c7
Re-instate docstrings and additional comments from earlier versions (…
noam-mendelson Oct 21, 2023
90633b7
Introduced process.py to handle intricacies of loading and processing…
noam-mendelson Oct 22, 2023
2ab6e2f
Formatting and docstring addition
noam-mendelson Oct 22, 2023
d207b8b
The previous commit mistakenly included a file, train.py, containing …
noam-mendelson Oct 22, 2023
37300bb
Introduce train.py script- Implement training and validation phases f…
noam-mendelson Oct 25, 2023
540aa1c
Populate predict.py script- evaluate CViT model accuracy on test data
noam-mendelson Oct 26, 2023
751fc26
Transferred content written in MS Word to README.md, formatted using …
noam-mendelson Oct 26, 2023
8ca0db5
New implementation of model example usage (predict.py)- replaced olde…
noam-mendelson Oct 26, 2023
fde09ac
process.py is made redundant due to restructuring of scripts- no long…
noam-mendelson Oct 26, 2023
a9b7d89
Error in populating train.py- Populate train.py content. Previous com…
noam-mendelson Oct 26, 2023
193f200
Finalise README.md, include additional CViT image and reword
noam-mendelson Oct 26, 2023
ec6ce9c
Remove __pycache__ and update .gitignore
noam-mendelson Oct 26, 2023
f74b5ab
Delete image_characteristics.py
noam-mendelson Oct 26, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Finalise README.md, include additional CViT image and reword
  • Loading branch information
noam-mendelson committed Oct 26, 2023
commit 193f20053606538ce19967f333193dda0cef54da
Binary file added Images/CViT.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
5 changes: 4 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,10 @@ The core of this model, the transformer section, is structured into stages; each

Unique to this model is the adaptive configuration of attention heads, MLP ratios, and other hyperparameters across different stages, allowing a more customised approach to learn these hierarchical representations. To ensure the model’s resilience against overfitting and facilitate more stabilised learning, the CViT employs specific regularisation techniques, including layer normalisation and dropout strategies.

The final part of the model compresses the transformer’s output, focusing on a CLS token and passes it through a linear layer that acts as a classifier. This translates the information from preceding stages into concrete predictions for
The final part of the model compresses the transformer’s output, focusing on to a CLS token and passes it through a linear layer that acts as a classifier. This translates the information from preceding stages into concrete predictions for image classifications.

A visual of this is shown below.
![Visualisation of CViT](Images/CViT.png)

## ADNI Brain Dataset & Pre-Processing

Expand Down
Binary file added __pycache__/dataset.cpython-310.pyc
Binary file not shown.
Binary file added __pycache__/modules.cpython-310.pyc
Binary file not shown.