ELEC 292 Visualization

Project Instructions
Goal:
The goal of the project is to build a desktop app that can distinguish between ‘walking’ and
‘jumping’ with reasonable accuracy, using the data collected from the accelerometers of a
smartphone.
Description:
The project involves building a small and simple desktop application that accepts accelerometer
data (x, y, and z axes) in CSV format, and writes the outputs into a separate CSV file. The output
CSV file contains the labels (‘walking’ or ‘jumping’) for the corresponding input data. For
classification purposes, the system will use a simple classifier, i.e., logistic regression.
In order to accomplish the goal of the final project and complete the report, the following 7 steps
are required:

1. Data collection
2. Data storing
3. Visualization
4. Pre-processing
5. Feature extraction & Normalization
6. Training the model
7. Creating a simple desktop application with a simple UI that shows the output
   Step 1. Data collection
   In this step, you need to collect data using your smart phone while ‘walking’ and ‘jumping’. There
   are a number of different apps you can use to collect accelerometer data from your smartphone.
   As an example, you may use an app called Phyphox, which works on both iOS and Android, and
   allows you to output the recorded signals as a CSV file. Other apps would also be acceptable.
   Data collection protocol: Recall that when collecting data, the diversity of the dataset will allow
   your system to work better when deployed. (a) Therefore, to maximize diversity, each team
   member must participate in the data collection process to create a total of 3 subsets (1 per
   member). (b) To further maximize diversity in your dataset, the phone should be placed in different
   positions. For example, you can place the phone in your front pocket, back pocket, pocket of a
   jacket, carry it in your hand, etc. 代 写ELEC 292 Visualization (c) The duration of data collection by each member must exceed
   5 minutes. Please note that it is important that you collect a roughly balanced dataset. In other
   words, the amount of time dedicated to each user, to each action (‘walking’ vs. ‘jumping’), to each
   phone position, and others, should be roughly the same.
   2
   Step 2. Data storing
   After transferring your dataset (all the subsets) to a computer and labeling them, store the
   dataset in an HDF5 file. This HDF5 file must be organized as follows:
   It is always a good idea to keep the data as originally collected, which is why we have the
   structure that we see on the right side of this image. But in order to create a simple AI system,
   you need to create separate training and test splits. To do so, divide each signal into 5-second
   windows, shuffle the segmented data, and use 90% for training and 10% for testing. This new
   dataset must also be stored in the HDF5 file as shown on the left side.
   Step 3. Visualization
   Data visualize is a critical step in the field of data science and will allow you to find issues in the
   data early on, and also become familiar with the data that you will be working with. So, in this
   step, you will need to visualize a few samples from your dataset (all three axes) and from both
   classes (‘walking’ and ‘jumping’). A simple acceleration vs. time would be a good start. But also
   think about additional creative ways of showing the data with the goal of representing your
   dataset. Provide some visualization for the meta-data for your dataset and sensors too. Don’t
   forget to use good visualization principles.
   Step 4. Pre-processing
   Remember, garbage in, garbage out! Almost any dataset, no matter how careful you were during
   collection, will inevitably contain some noise. First, the data will likely contain noise, which may
   be reduced by a moving average filter. Second, after feature extraction (next step), try to detect
   and remove the outliers in your collected data. Please note that if by removing outliers, the data
   becomes too imbalanced, remedy this. Finally, normalize the data so that it becomes suitable for
   logistic regression.
   Step 5. Feature extraction & Normalization
   From each time window (the 5-second segments that you created and stored in the HDF5 file),
   extract a minimum of 10 different features. These features could be maximum, minimum, range,
   mean, median, variance, skewness, etc. Additional features may be explored as well. After feature
   extraction has been performed, you will be required to apply a normalization technique for
   preventing features with larger scales from disproportionately influencing the results. Common
   normalization techniques are min-max scaling, z-score standardization, etc.
   Step 6. Creating a classifier
   Using the features from the preprocessed training set, train a logistic regression model to classify
   the data into ‘walking’ and ‘jumping’ classes. Once training is complete, apply it on the test set
   and record the accuracy. You should also monitor and record the training curves during the
   training process. Note that during the training phase, your test set must not leak into the training
   set (no overlap between the segments used for training and testing).
   3
   Step 7. Deploying the trained classifier in a desktop app
   The last step is to deploy your final model in a desktop app. For building a simple graphical user
   interface in Python, you can use Tkinter or PyQt5 libraries. As mentioned, this app must accept
   an input file in CSV format and generate a CSV file as the output, which includes the labels
   (walking or jumping) for each window in the input file. Run a demo for your built app in which you
   input a CSV file and the app generates a plot which represents the outputs. Once deployed, how
   did you test the system to ensure it works as intended?
   Step 8. Demo video
   Record your screen while running a demo with the created app. The video should feature all team
   members and show short snippets of your data collection process, as well as the app in action.
   The video should also explain your project in a few sentences. It should be between 1 to 3
   minutes.
   Step 9. Report
   Write a report for the project. The project should contain:

• A title page containing the following:
  Course: ELEC292
  Project Report
  Group Number: _
  Names, Student Numbers, and Email Addresses:
  Date:
• After the title page, the rest of the document must be in 12 point Times New Roman font,
  single spaced, 1 inch margins, and with page numbers in the bottom center of each page.
• Every student must submit a separate copy that is identical to their teammates. This is
  done as a signoff, indicating that each member has participated and agrees with the
  content. It will also make grading and tracking easier.
• As a rule of thumb, the report should be between 15 to 20 pages including references and
  figures.
• Note that where you refer to online sources (articles, websites, etc.) the references must
  be mentioned in the reference section of the document (in the end of the document), and
  the references should be referred to in the text. Here is a brief description of how proper
  citation and references should be used: labwrite.ncsu.edu/res/res-cit…
• In this report, you must use the IEEE format for references.
• Note that in your report, you must not “copy-paste” text from other resources, even though
  you are citing them. Text should be read, understood, and paraphrased, with proper
  citation of the original reference.
• Proper editing (grammar, typos, etc.) is expected for the reports.
• The report should clearly describe each step and provide the requested material.
• The report must have the following sections:
  4
  o 1. Data Collection: How did you collect the data, label it, transfer it to a PC, and
  what challenges did you deal with from during the data collection step. How did
  you overcome them? Mention all the hardware and software used.
  o 2. Data Storing: Provide a full description of the way you stored the collected data.
  o 3. Visualization: Provide all the plots that you created for visualization purposes,
  and provide appropriate descriptions for each of them. What did you learn?
  Knowing what you learn from the plots, if you were to re-do your data collection,
  how would you do things differently?
  o 4. Preprocessing: Clearly describe the measures you took for preprocessing, and
  how it impacted the data (you may use a few plots here too). Why did you choose
  the parameters that you did (e.g., size of moving average)?
  o 5. Feature Extraction & Normalization: What features did you extract and why?
  References may be useful here. Explain the process of feature extraction and
  normalization, then justify your choices.
  o 6. Training the classifier: Provide a description of the way you trained the logistic
  regression model. This section must include the learning curves and your accuracy
  on the training and test sets. What parameters did you use here? Justify your
  answers.
  o 7. Model deployment: This section should include the details of how you deployed
  the trained model into a desktop app. Provide screenshots of the GUI you created
  along with its description, and justify your design choices.
• At the end of the report, a Participation Report must be added. Please note that the
  project should be done together and collaboratively. It is not acceptable for one person to
  do the technical work and another to simply write the report. Having said this, a reasonable
  division of work is allowed for type up or other simple tasks. At the end of the report,
  provide a table that clearly shows which members have been present for and contributed
  to each question. Please note that should someone not pull roughly 1/3 of the weight of
  the project, they may lose points.
  Submission:
  The following items will need to be submitted in OnQ:
• 1. Your project report in PDF format
• 2. Your saved HDF5 file in the mentioned format
• 3. The video as described earlier
• 4. Your clean and executable Python code, which contains the code for ranging from (1)
     visualization, (2) pre-processing, (3) feature extraction, (4) training and running the
     model
     Bonus:
     Part 1: This part of the final project is not mandatory and
     serves as a bonus deliverable, which can gain up to 10
     bonus points(out of 100) on your project!
     The app that you created, works offline. In other words, the
     app is not able to classify activities from your smart phone
     in real-time. For the bonus component of the project, our goal is to build a desktop app which can
     real-time
     5
     read the accelerometer data from your smart phone in a real-time and classify it immediately. As
     shown in the image above, your smart phone would need to send the accelerometer data to the
     app in real-time, and the app would show the class of action (e.g., ‘walking’) in real-time.
     Hint: For reading the accelerometer data online, you may use the ‘Enable remote access’ option
     of the Phyphox app. By doing so, you will have access to the accelerometer data in a web page.
     Then, you may use Beautiful Soup and Selenium libraries to read the data. Alternative ways
     include using Bluetooth to send the data to the PC in real-time.
     Part 2: In this step, you will have to implement the SVM and Random Forest classifier from scratch
     without the use of any existing libraries for the model, such as, scikit-learn. You are free to use
     libraries for basic operations, such as, NumPy. Record the accuracy of your implemented models
     that you built from scratch on test set. Then, compare the performance of your own implemented
     models (without using libraries) with the models implemented using pre-existing libraries. This
     direct comparison will highlight the efficacy of your custom-built models versus standardized
     library models. Finally, provide overall insights on the comparison of models and explain the
     outcomes.
     Deliverables for the bonus component:

1. The report should be extended by 3-5 pages. These additional materials should include:
   o All the details of how the data was transferred to the PC in real-time
   o A description of any changes made to the desktop app and its GUI
   o A description of any changes made to the trained classifier
   o A general description of how you implemented SVM and Random Forest
   from scratch
   o A table that shows the accuracy of models on test sets that you implemented and
   the models exist in standard libraries
2. The video should clearly show that a person is carrying a phone and the desktop app is
   classifying their actions in real-time
3. Your clean and executable Python code
   General note: If you attempted anything but could not get it to work, whether for the main part of
   the project or the bonus component, you should mention what you did, what is your hypothesis
   for it not working, and how things should likely change to make it work, to receive some partial
   marks.
   Grading:
   A 5-point scale will be used for grading different aspects of the project. This 5-point scale will be
   as follows:
   Quality Grade Definition
   Excellent 4/4 Explanations are clear and easy to
   understand, complete
   Good 3/4 Explanations are lacking a bit of
   clarity or completeness, but is
   generally in good shape
   Average 2/4 Several aspects are missing or
   incorrect. There is quite a bit of
   room for improvement
   6
   Poor 1/4 Most aspects are missing or
   incorrect
   Not done 0/4 The question is not answered at all
   The following grading scheme will be used:
   The final grade for the project will be calculated out of 100. Up to 10 points for the bonus component will
   then be added to this grade (if available). The final score will be multiplied by 0.3 to obtain your project
   grade out of 30.
   Note: The use of generative AI such as ChatGPT is prohibited in Final Project submission and is
   considered a violation of the academic integrity principles of Queen's University. Please note that, we
   will check the assignments using the latest AI-content detectors on a random basis
   Task Grade Weight
4. Data collection / 4 Completeness/thoroughness, balance, diversity, good
   data collection principles
   3
5. Data storing / 4 Proper data storage in the specified format, reasonable
   train-test splits, no data leakage
   2
6. Visualization / 4 Several samples visualized, each class represented,
   meta-data visualized, additional creative plots, good
   visualization principles
   2
7. Pre-processing / 4 Removal/reduction of outliers, removal/reduction of
   noise, discussion or remedy of imbalance, normalization,
   further visualization of data after pre-processing
   2
8. Feature extraction / 4 Identification and extraction of a minimum of 10 different
   features, proper
   2
9. Training the mode / 4 Proper construction
   reasonable results
   and training of the model, 2
10. Desktop app / 4 Nice/clean UI, functionality, testing of the system 2
11. Demo video / 4 Proper description and demo of the work, participation
    from everyone
    3
12. Report / 4 Proper structure, detailed description, high quality
    images, writing and editing quality, references and
    citations, cover page, division of work statement,
    providing everything described under Step 9 on pages
    WX：codinghelp