I do cool things. I am a creative computer engineer

Project Description

Project description not available yet. Stay tuned or contact Marco for more details.

Project Description

Project description not available yet. Stay tuned or contact Marco for more details.

Project Description

Project description not available yet. Stay tuned or contact Marco for more details.

Project Description

Web-based application aimed at creating and debugging data analysis and machine learning pipelines. The user imports his data and starts with a specific goal (eg. Understanding the structure of unlabeled data, classifying data, predicting future values, ...). A visual programming interface and a suggestion engine help the user quickly build and run their pipeline, of which they can track results and performance. The tool enables multiscale programming, allowing users to modify existing code blocks or create custom ones. Suggestions are generated based on the success of previous pipelines having similar input data and goal, created by several data scientists.

Project Description

Unishare is a web platform offering several university services to more than 15'000 students in Italy, distributed across more than 23 university. On top of the Unishare website, I coordinated the development of the mobile application, soon available on both Apple Store and Google Play. The mobile app has been developed with React Native.

Features

• App developed with React Native for Android and iOS
• Coordination a team of 4 developers

Project Description

Built with the feedback of several neuroscientists at IBM research, Holobrain is both a VR and AR application for exploration and analysis of brain imaging data. The tool is able to import MRI and f-MRI scans, compare them with brain templates and automatically parcellate them. Users can interactively observe and filter the data interactively, leveraging several data aggregation techniques to generate insights and validate their hypotheses. Holobrain is compatible with existing FreeSurfer software and can be used to show and enhance the neuroscience results.

Features

• Visual tool developed with Unity 3D for Hololens and HTC Vive
• Research-grade neuroscience analysis through innovative interaction and data aggregation techniques
• Support for MRI, f-MRI and brain tractography data

Project Description

Project description not available yet. Stay tuned or contact Marco for more details.

Project Description

Project description not available yet. Stay tuned or contact Marco for more details.

Project Description

Detecting motor activities from sensor datasets is becoming increasingly common in a wide range of applications with the rapid commoditization of wearable sensors. To detect activities, data scientists iteratively experiment with different classifiers before deciding on a single model. Evaluating, comparing, and reasoning about prediction results of alternative classifiers is a crucial step in the process of iterative model development. However, standard aggregate performance metrics (such as accuracy score) and textual display of individual event sequences have limited granularity and scalability to effectively perform this critical step. <br/> To ameliorate these limitations, we introduce Track Xplorer, an interactive visualization system to query, analyze and compare the classification output of activity detection in multi-sensor data. Track Xplorer visualizes the results of different classifiers as well as the ground truth labels and the video of activities as temporally-aligned linear tracks. Through coordinated track visualizations, Track Xplorer enables users to interactively explore and compare the results of different classifiers, assess their accuracy with respect to the ground truth labels and video. Users can brush arbitrary regions of any classifier track, zoom in and out with ease, and playback the corresponding video segment to contextualize the performance of the classifier within the selected region. Track Xplorer also contributes an algebra over track representations to filter, compose, and compare classification outputs, enabling users to effectively reason about the performance of classifiers. We demonstrate how our tool helps data scientists debug misclassifications and improve the prediction performance in developing activity classifiers for real-world, multi-sensor data gathered from Parkinson's patients.

Project Description

Virtual reality application devoted to data exploration, with particular focus on dimensionality reduction and clustering techniques. This research project represents a first attempt to leverage MR/VR technology to better analyze complex multidimensional datasets, which require interactive experimentation, automation and better perspective on the data in order to achieve meaningful insights.

Features

• Introduces the first-ever port of the famous library D3.js to MR/VR
• Comprehends a suggestion engine to guide users during the analysis
• Enables complex voice control for quick data manipulation
• Offers the possibility to quickly switch between 2D and 3D visualizations

Project Description

Project description not available yet. Stay tuned or contact Marco for more details.

Project Description

Detecting motor activity in temporal data collected by sensors is an important task in wearable sensor applications. Datasets of sensor data often contain limited information about the usage context of the devices and video validation is not always possible, causing a lack of interpretable ground-truth labels. This lack of context can limit the understanding of sensors data, causing data scientists to make incorrect assumptions or to run machine learning algorithms as black-box models. We introduce BlueSky Wanderer, an interactive visual analysis tool for running classification algorithms on live-streaming sensor data. Our system provides visual and quantitative methods to iteratively reason on classification performance and to develop better intuition about structured patterns in data. In particular, BlueSky Wanderer enables quick debugging, validation, and dynamic fine-tuning of classification models for activity recognition. We use a case study to demonstrate how our approach can improve the development of a set of motion classifiers for monitoring the symptoms of Parkinson's disease.

Project Description

Project description not available yet. Stay tuned or contact Marco for more details.

Project Description

The BlueSky booth experience comprehends an interactive application to be integrated at IBM conference booths. It includes a Kinect v2 and an IMU wrist sensor streaming live data to the application backend, which computes real time motor assessments about the user. An animated avatar guides the user through the booth experience, introducing him to the IBM BlueSky technology for Parkinson's disease scoring.

Features

• Interactive application developed with Unity 3D
• Live data streaming from Kinect v2 and IMU wrist sensor
• Real time ML-based hand motor activity detection and walk assessment
• Development of custom 3D avatar animations

Project Description

Dimensionality reduction is a common method for analyzing and visualizing high-dimensional data across domains. Dimensionality-reduction algorithms involve complex optimizations and the reduced dimensions computed by these algorithms generally lack clear relation to the initial data dimensions. Therefore, interpreting and reasoning about dimensionality reductions can be difficult. In this work, we introduce two interaction techniques, forward projection and backward projection}, for reasoning dynamically about scatter plots of dimensionally reduced data. We also contribute two related visualization techniques, prolines and feasibility map to facilitate and enrich the effective use of the proposed interactions, which we integrate in a new tool called Praxis. To evaluate our techniques, we first analyze their time and accuracy performance across varying sample and dimension sizes. We then conduct a user study in which twelve data scientists use Praxis so as to assess the usefulness of the techniques in performing exploratory data analysis tasks. Results suggest that our visual interactions are intuitive and effective for exploring dimensionality reductions and generating hypotheses about the underlying data.

Project Description

Project description not available yet. Stay tuned or contact Marco for more details.

Project Description

Project description not available yet. Stay tuned or contact Marco for more details.

Project Description

DigitalQuest is mobile application aimed at the creation and deployment of digital scavenger hunts, which can be experienced through augmented reality. With respect to the first version of DigitalQuest, maps are tridimensional and created based on real terrain information. Items and quests are generated automatically by analyzing suitable areas around the player, enabling a new "World Exploration Mode" similar to the videogame Pokemon GO.

Features

• Videogame developed with Unity3D
• GPS smoothing, IMU + SLAM based augmented reality
• Integration of Google Places and other location APIs

Project Description

Project description not available yet. Stay tuned or contact Marco for more details.

Project Description

This is a room-scale virtual reality game for the HTC Vive where players motion controllers to fire a slingshot at multi-colored targets (low poly 3D shapes). Players wear an EEG brain-sensing headband that makes time slow down as the brain reaches a mindful state. Slowing time makes targets easier to shoot and creates a feedback loop that promotes mindfulness. Target colors flash and disappear, which requires working memory to remember which targets to shoot. Players progress through levels unlocking new game mechanics such as new firing modes and target types.

Features

• Virtual Reality videogame for HTC Vive
• Control of time through real-time analysis EEG data
• Dynamic environment changing based on user's emotions

Project Description

In this document we present a novel approach to the design of mixed reality (MR) applications, which combines elements from markerless and locationbased augmented reality in order to explore new types of interaction, leveraging a spatial representation of virtual content. In particular, we propose a method for developing both a mobile application, that can be used by people to see augmented content in the real world, and an editor application, which can be used to design and create MR experiences. In our presentation, we deal with the currently available mobile technologies and we discuss the integration of dierent techniques in order to improve tracking within the context of our location-based approach, in which every content has a dened position in real space. After discussing the advantages and the new interaction possibilities enabled by our method, we dene the requirements for a MR authoring tool and we propose our own implementation, aimed at decoupling the editing process from the use of tracking techniques. We particularly focus on the mapping between real-world and virtual coordinates and on the possibilities enabled by real-time editing, which allows the designer to remotely preview the MR experience and to interact with users. We demonstrate the usefulness of our method by presenting two applications developed with our approach and by analyzing some real-world examples.

Features

• Introduction of an intelligent "triple camera approach", merging pattern recognition, SLAM tecniques and mobile sensors
• "Mapping between the two worlds", enabling a continuous, absolute camera pose estimation
• Innovative authoring tool for editing AR content and preview the applications remotely

Project Description

CAVE-AR is an innovative authoring tool for augmented and mixed reality applications built on top of a CAVE2 system, composed of a 36-node cluster and of 72 displays arranged in a 320° cylindrical shape. The virtual environment is a partial representation of the outer world and is mapped 1-to-1 with real geolocations, allowing to preview how virtual content is displayed in the real world. Networked features allow to represent real-time where mobile users are looking at in the real-world, enabling positional error correction, assistance and centralized control of individual or collaborative tasks.

Features

• Networked 36-node cluster tracking mobile users in the outer world
• Real-time editing of augmented and mixed reality experiences in a 1-to-1 mapped virtual environment
• 74 megapixels visualization of users' real-world behavior with many interaction possibilities
• Centralized assignement and control of independent or collaborative tasks

Project Description

With the advent of new hardware and software technologies, virtual reality has gained a significant momentum recently. VR design tools, such as game engines, have become much more accessible and are being used in a variety of applications ranging from physical rehabilitation to immersive art. These tools, however, offer a limited set of tools for audio processing in 3D virtual environments. Furthermore, they are platform-dependent due to performance requirements and feature separate editing and rendering modes, which can be limiting for sonic VR implementations. To address these, we introduce a novel webbased system that makes it possible to compose and control the binaural rendering of a dynamic open-space auditory scene. Developed within a framework of well-established theories on sound, our system enables a highly detailed bottom-up construction of interactive virtual soundscapes by offering tools to populate navigable sound fields at various scales (i.e. from sound cones to 3D sound objects to sound zones). Based on modern web technologies, such as WebGL and Web Audio, our system operates on both desktop computers and mobile devices. This enables our system to be used for a variety of mixed reality applications, including those where users can simultaneously manipulate and experience a virtual soundscape.

Project Description

Funded by the Histry Museum of Chicago, this project consists in a mobile application aimed at orienting tourists around the city and at making publicly available a huge dataset of historical photographs of Chicago. By leveraging our own augmented reality system for placing content into 3D space, overlays of old urban elements and buildings are superimposed and matched onto current views of the city, showing to the user how life in Chicago was a hundred years ago.

Features

• Overlay of digital content onto current views of the city
• Innovative spatial approach to combine location-based and marker-less AR
• Intelligent combination of "helper cameras" to leverage the most suitable type of tracking based on environmental circumstances

Project Description

Project description not available yet. Stay tuned or contact Marco for more details.

Project Description

Research project made for the Computer Graphics II course at University Of Illinois At Chicago. Virtual Maps is an attemps to create a simple and automatizable way to reconstruct the geometry of urban environments by leveraging Google STreet View imagery. In particular, depth information is extracted and combined with panoramic images, in order to create an explorable point cloud representation of a location. Additionally, more panoramic images can be combined in order to compose a larger urban environment.

Features

• Extraction of depth information from Google Street View panoramas
• Projection into a point cloud
• Composition of multiple point clouds to reconstruct urban environments

Project Description

Creative project made for the Computer Graphics II course at University Of Illinois At Chicago. Street View Timelaps consists in a web application created with Three.js that allows the user to virtually reach a destination directly from his mobile device. The application gathers all the panoramic images available along the road to the target location and combines them in order to create an interactive video timelapse starting from the user current location. During the timelapse, the user can easily look around the environment by orientating his device. The final destination can be provided as a normal address or as a photo, from which the application will extract the location where is was shot.

Features

• Mobile-oriented panoramic images viewer
• Given a photo or an address, brings the user to that location through a timelapse
• Recreates a complete 360° experience of the trip to the destination

Project Description

Rehabilitation Avatar is a project developed in the immersive environment CAVE2 of the Electronic and Visualization Laboratory of University Of Illinois At Chicago. The project was intended for the Human-Computer Interaction course held by Prof. Elizabeta Marai and had Prof. James Patton from the Rehabilitation Institute Of Chicago as a client. The scope of the project was the development of a system that allows patients to do movement rehabilitation in a virtual reality environment. Users should be able to reach some virtual objects with the movement of their hands, but only through some 3rd-person perspectives of an avatar representing the users and matching their movements. This project is involved in a larger study about first and third-person perspective virtual reality for rehabilitation.

Features

• Movement rehabilitation in virtual reality
• Developed with Unity 3D on a 32-nodes / 64-displays cluster
• 20-cameras TrackD system with additional Kinect v2 sensor

Project Description

Videogame created for the course Videogame Design And Programming held by Prof. Lanzi at Politecnico di Milano. It is an innovative RPG-style game based on exploration and evolution of the main character, who will learn during his journey particular skills - able to bring back the colors to a world which long time ago had become misteriously black and white.

Features

• RPG-style videogame for desktop and mobile platforms
• Innovative gameplay involving the use of colors
• Three different worlds to explore and more than 3h of gameplay

Project Description

Unishare is a website aimed at helping students during their university life. Born as a sort of Italian version of ratemyprofessor.com, Unishare now offers several services from selling books to exchanging didactic material, allowing also interaction between students. It is also accessible via mobile application and has turned in 2015 into a startup company of which I represent one of the three cofounders and the CTO.

Features

• Website aimed at helping students during their university life
• 23 Italian universities involved for almost 10'000 students
• PHP backend with MySQL database, more than 30'000 lines of code

Project Description

Digital Quest is an innovative videogame that leverages the classic scavenger hunt game in order to create a futuristic mixed reality environment, suited both for fun and for marketing / team building purposes. The videogame approaches new sensor fusion and computer vision techniques for allowing a natural displacement of virtual objects in the real world.

Features

• Sensor Fusion for enhancing gyro, compass and GPS measurements
• Leverages Computer Vision techniques for augmenting scenes
• Virtual - real world mapping for a complete mixed reality experience

Project Description

Wildlife Defense is a videogame developed non-stop in 36 hours during a hackaton organized by the company Internet Of Elephants. Classified at the second place, Wildlife Defense aims at raising awareness about the threats which may involve animals in the savannah.

Features

• Videogame available both on desktop and mobile platforms
• Raise awareness on the threats caused by humans by making the player assume the perspective of the animals, which need to adapt to a dynamic environment in order to survive

Project Description

The aim of this project is to try to improve the processing time of a convolutional neural network recognizing handwritten digits. The network setup is done with LUA and Torch framework, while the feedforward operation is implemented in C and synthesized on the hardware through an optimized design, that handles transfer of data from processor to memory and thorugh the UART. So, each feedforward request is passed to the FPGA and executed, then the result is passed back to the original caller.

Features

• Implementation in C of the feedforward operation of CNN
• Definition and training of the network in LUA with Torch framework
• Optimized hardware design to speed up the process

Project Description

This project involves securing a chat system with centralized key management through a flat table. One node keeps track of all the keys and manages the addition and removal of clients, assuring the communication is secure for both who remians in the network and who enters / leaves.

Features

• Centralized form of key distribution in distributed systems
• Encryption of a chat application for 8 users connected on a LAN

Project Description

This Kaggle.com challenge involved developing a predictive framework able to infer the final destination of taxi rides in Porto, Portugal based on their (initial) partial trajectories. The output of the framework is the final trip's destination and is used to optimize the taxi service in the city, enabling the decision for which next customer to assign to each taxi. Our working group classified at the 3rd place in the challenge.

Features

• Estimation of the possible route taken by taxi drivers considering many parameters such as previous trips and starting point
• Development of a framework for optimizing taxi routes for consecutive customers
• Mostly implemented with R, Python and scikit-learn

Project Description

Rossmann operates over 3,000 drug stores in 7 European countries. Currently, Rossmann store managers are tasked with predicting their daily sales for up to six weeks in advance. Store sales are influenced by many factors, including promotions, competition, school and state holidays, seasonality, and locality. In this Kaggle.com competition, my team developed a system for predicting 6 weeks of daily sales for 1,115 stores located across Germany.

Features

• Analysis of relevant factors in store sales forecast for a famous German company
• Prediction of sales expected during the enxt 6 weeks for Business Intelligence purposes
• Mostly implemented with Python and skikit-clearn

Project Description

Masterpage is a web-based service aimed at helping Italian local shops and small businesses in surviving the economical crisis, by providing free services related to advertisement, interaction with customers and fidelization, collaboration between companies. The project consists in a social network to which both custumers and shop owners can subscribe and take advantage of the large number of available features. The website is based on the Apache-PHP-Mysql stack, while the mobile application has both an Android native and a web-app implementations.

Features

• Social network for shops and customers based on innovative interactions to the advantage of both
• Many free services offered to shops and small companies, supporting also collaboration among shops
• Reward-based system for involving users
• PHP implementation with MySql database, with Bootstrap-based front end

Project Description

Project description not available yet. Stay tuned or contact Marco for more details.