Invited talk – Tasos Kyrillidis

Title: «Distributed neural network training via independent subnets»Wednesday, 2 March 2022, 12:00 – 13:30Auditorium, Department of Electrical and Computer Engineering, Karamanli & Lygeris Str Abstract:  Distributed machine learning (ML) can bring more computational resources to bear than single-machine learning, thus enabling reductions in training time. Distributed learning partitions models and data over many machines, allowing model and dataset sizes beyond the available compute power and memory of a single machine. In practice though, distributed ML is challenging when distribution is mandatory, rather than chosen by the practitioner. In such scenarios, data could unavoidably be separated among workers due to limited memory capacity per worker or even because of data privacy issues. There, existing distributed methods will utterly fail due to dominant transfer costs across workers, or do not even apply. We propose a new approach to distributed fully connected neural network learning, called independent subnet training (IST), to handle these cases. In IST, the original network is decomposed into a set of narrow subnetworks with the same depth. These subnetworks are then trained locally before parameters are exchanged to produce new subnets and the training cycle repeats. Such a naturally “model parallel” approach limits memory usage by storing only a portion of network parameters on each device. Additionally, no requirements exist for sharing data between workers (i.e., subnet training is local and independent) and communication volume and frequency are reduced by decomposing the original network into independent subnets. These properties of IST can cope with issues due to distributed data, slow interconnects, or limited device memory, making IST a suitable approach for cases of mandatory distribution. This talk will provide results on MLPs, ResNets, CNNs, efficient pretraining tasks, GCNs as well as some theoretical guarantees. Biography: Mr Anastasios Kyrillidis is an Assistant Professor at the Computer Science department at Rice University. Prior to that, he was a Goldstine PostDoctoral Fellow at IBM T. J. Watson Research Center (NY), and a Simons Foundation PostDoc member at the University of Texas at Austin. He finished his PhD at the CS Department of EPFL (Switzerland). Anastasios Kyrillidis got his M.Sc. and Diploma from Electronic and Computer Engineering Dept. at Technical University of Crete (Chania). His research interests include (but not limited to): Files: invited_speaker___anastasios_kyrillidis.pdf

Read More

Field Service Electrical Engineer (Thessaloniki)

  Kariera’s Hiring Solutions team is looking for a Field Service Engineer on behalf of a client-company, world-leading provider of sustainable productivity solutions. As a Field Service Engineer, you will be the customer’s first point of contact and an ambassador for the company’s brand. Technical expertise, excellent communication skills, responsiveness to customer demands, computer literacy and accurate service record keeping are important attributes for this position. Your main responsibility will be to perform routine service, fix breakdowns, identify faults, and perform major overhauls on our customer’s air compressors. The role will involve travelling to customer sites mainly within Epirus, Macedonia and Thrace region. In few cases, travels can take for several days in a row. Περισσότερες πληροφορίες καθώς και την αίτηση προς συμπλήρωση θα βρείτε ΕΔΩ (σύνδεσμος)

Read More

Career Opportunity Deloitte

Position summary  The Cyber Security Team focusing on Identity & Access Management designs and implements business-friendly Identity & Access Management control frameworks that consistently enforce identity and access policy across business processes and hybrid IT infrastructure. Quite simply, we deliver secure access control that dovetails with existing and new applications.  REQUIREMENTS  -Academic background (BSc/MSc) related to Information Technology, Computer and Data Science, Business Informatics, Engineering. We also welcome graduates with a business background, who have major in Information Systems Management or any other IT related major.-Excellent command of Greek and English language-Knowledge of Italian and/or German language will be considered a plus-Strong interest in Security themes and data analysis-Good knowledge of programming languages (e.g. C, C#, Java, etc.)–Analytic mindset-Willing to travel for short or medium-term periods-Good interpersonal and communication skills-Aptitude to team working -Client Orientation For the Application form and more information  HERE

Read More
Χρησιμοποιούμε cookies για την εξατομίκευση του περιεχομένου και των διαφημίσεων, για την παροχή λειτουργιών κοινωνικής δικτύωσης και για την ανάλυση της επισκεψιμότητάς μας. Μοιραζόμαστε επίσης πληροφορίες σχετικά με τη χρήση του ιστότοπού μας από εσάς με τους συνεργάτες μας στα μέσα κοινωνικής δικτύωσης, τη διαφήμιση και την ανάλυση. View more
Cookies settings
Αποδοχή
Απόρριψη
Privacy & Cookie policy
Privacy & Cookies policy
Cookie name Active
Χρησιμοποιούμε cookies για την εξατομίκευση του περιεχομένου και των διαφημίσεων, για την παροχή λειτουργιών κοινωνικής δικτύωσης και για την ανάλυση της επισκεψιμότητάς μας. Μοιραζόμαστε επίσης πληροφορίες σχετικά με τη χρήση του ιστότοπού μας από εσάς με τους συνεργάτες μας στα μέσα κοινωνικής δικτύωσης, τη διαφήμιση και την ανάλυση.
Save settings
Cookies settings