HTCondor Week 2019 Summary

Monday

Philosophy of HTCondor

Speaker(s): Greg Thain ( Center for High Throughput Computing ) Introduction to CHTC

Speaker(s): Lauren Michael ( UW-Madison ) Intro to HTCondor Job Submission

Speaker(s): Christina Koch ( UW Madison ) ClassAd Advanced Tutorial

Speaker(s): Jaime Frey ( Center for High-Throughput Computing ) HTCondor in the Cloud

Speaker(s): Todd Miller ( CHTC ) HTCondor Job Testing, Troubleshooting, and Special Use Cases

Speaker(s): Christina Koch ( UW Madison ) Negotiator Policy and Configuration

Speaker(s): Greg Thain ( Center for High Throughput Computing ) Manage Workflows with HTCondor’s DAGMan

Speaker(s): Lauren Michael ( UW-Madison ) Advanced Submission Tutorial

Speaker(s): John Knoeller ( University of Wisconsin, Madison ) Inferring Effective Connectivity From High-Dimensional ECoG Recordings

Speaker(s): Chris Endemann ( UW-Madison Department of Anesthesiology ) Python Bindings Tutorial

Speaker(s): Brian Bockelman ( University of Nebraska-Lincoln ) Genomic ancestry analysis in wild hybrid house mice

Speaker(s): Megan Frayer ( UW-Madison Laboratory of Genetics ) Uncertainty propagation in Fuel Cycle simulation using HTC

Speaker(s): Baptiste Mouginot ( UW-Madison Department of Engineering ) Work Queue tutorial

Speaker(s): Benjamin Tovar ( University of Notre Dame ) Alignment and CNV analysis in Cattle

Speaker(s): Beth Lett ( UW-Madison Department of Animal Science ) Image Analysis and Computation-Based Phenotyping

Speaker(s): Nathan Miller ( UW-Madison Department of Botany ) Pegasus Workshop

Speaker(s): Karan Vahi ( Pegasus - Team USC Information Sciences Institute ) Grid Search Methods for Modeling Polymerization Kinetics

Speaker(s): Katie Ziebarth ( UW-Madison Department of Chemistry ) Studying RNA Virus Replication with Cryo-Electron Microscopy on HTC

Speaker(s): Hong Zhan ( Morgridge Institute for Research )

Tuesday

Welcome to HTCondor Week

Speaker(s): Miron Livny ( UW-Madison CHTC ) Ice Fishing for Neutrinos: Exploring the mysteries of the cosmos from beneath the South Pole

Speaker(s): Francis Halzen ( UW-Madison WIPAC ) Computer and Data Sciences at UW-Madison

Speaker(s): Remzi Arpaci-Dusseau ( UW-Madison Department of Computer Sciences ) IceCube Computing

Speaker(s): Benedikt Riedel ( UW-Madison WIPAC ) HTCondor in Foxconn Hyperscale AI HPC Cloud

Speaker(s): Hank Du ( Foxconn Industrial Internet ) Orpheus: Efficient Distributed Machine Learning via System and Algorithm Co- design

Speaker(s): Pengtao Xie ( Petuum Inc. ) What's new in HTCondor? What is upcoming?

Speaker(s): Todd Tannenbaum ( University of Wisconsin ) Space Telescope Science Institute (STScI) and HTCondor – Reporting on today and exploring tomorrow.

Speaker(s): Mary Romelfanger ( Space Telescope Science Institute ) Simplifying submitting for our users with a custom submission API

Speaker(s): Collin Mehring ( Dreamworks Animation ) Updates from LIGO

Speaker(s): James Clark ( Georgia Institute of Technology (LIGO) ) 'Startd flocking' at and around the Milan Physics Dept.

Speaker(s): Francesco Prelz ( INFN - Sezione di Milano ) HTCondor in Astronomy at NCSA

Speaker(s): Greg Daues ( NCSA ) Michael Johnson ( National Center for Supercomputing Applications ) An opportunistic HTCondor pool inside a interactive-friendly Kubernetes cluster

Speaker(s): Igor Sfiligoi ( University of California San Diego ) Pegasus : Introducing Integrity to Scientific Workflows

Speaker(s): Karan Vahi ( Pegasus - Team USC Information Sciences Institute ) AI platform on HTcondor

Speaker(s): Vishnu Vettrivel ( Wisecube ) Tuesday Closing Remarks

Speaker(s): Miron Livny ( UW-Madison CHTC )

Wednesday

Facilitating High Throughput Computing

Speaker(s): Lauren Michael ( UW-Madison ) Improving the quality of my research on urban residential hydrology by increasing the quantity of simulations using HTCondor

Speaker(s): Carolyn Voter ( University of Wisconsin-Madison ) Analyzing Soil Microbial Community Sequencing Data with the CHTC

Speaker(s): Thea Whitman ( UW-Madison Department of Soil Science ) High Throughput Computing For the Generation of a Self-Stabilizing Laser Sail Capable of Exploring Beyond Our Solar System

Speaker(s): Joel Siegel ( UW-Madison Department of Physics ) High-throughput processing of telemetry data

Speaker(s): Colton Mikes ( Texas Tech University ) DJ Lee ( Brigham Young University ) Richard Erickson ( US Geological Survey ) Deploying and managing containers on OSG

Speaker(s): Marco Mambelli ( Fermilab ) Scientific Computing using AWS and HTCondor

Speaker(s): Sanjay Padhi ( AWS ) HTCondor Solutions for the Future of the CMS Submission Infrastructure

Speaker(s): JAMES LETTS ( UCSD ) Managing a Dynamic Sharded Pool

Speaker(s): Anthony Tiradani ( Fermilab National Accelerator Laboratory ) HTCondor with google Cloud Platform

Speaker(s): Michiru Kaneda ( The University of Tokyo ) HTCondor Solutions for Several Scenarios at IHEP

Speaker(s): Jiaheng Zou ( Institute of High Energy Physics (IHEP) of the Chinese Academy of Sciences (CAS) ) Job Submission via Share Filesystem: Running HTCondor Jobs on Isolated HPC Machines

Speaker(s): Jaime Frey ( Center for High-Throughput Computing ) Python bindings based monitoring at CMS

Speaker(s): Diego Davila ( CERN ) Thinking about HTC Notebooks: High Throughput Computing via Jupyter Notebooks

Speaker(s): Todd Tannenbaum ( University of Wisconsin ) HTMap: High-Throughput Computing in Python

Speaker(s): Josh Karpel ( University of Wisconsin - Madison ) Wednesday Closing Remarks

Speaker(s): Miron Livny ( UW-Madison CHTC )

Thursday

HTCondor Architecture

Speaker(s): Todd Tannenbaum ( University of Wisconsin ) Installation and configuration of a HTCondor Pool

Speaker(s): Tim Theisen ( UW-Madison CHTC ) Moving your job's data

Speaker(s): Brian Bockelman ( Morgridge Institute for Research ) Event-Sourced Monitoring of your HTCondor Cluster

Speaker(s): Kevin Retzke ( Fermilab ) Federating HTCondor Pools

Speaker(s): Greg Thain ( Center for High Throughput Computing ) SciTokens and Credential Management

Speaker(s): Jason Patton ( University of Wisconsin ) Zach Miller ( UW Madison ) Schedd Job Transforms

Speaker(s): John Knoeller ( University of Wisconsin, Madison )