NetworkBased Computing: Issues, Trends, and Challenges

1
Who Am I?

• Prof. Christopher Stewart (Chris)
• DL 793
• http//www.cse.ohio-state.edu/cstewart
• Research interest Sustainable Datacenters
• A datacenter is a warehouse full of servers often
  used to run 24x7 web applications
• A sustainable datacenter uses renewable energy to
  reduce its carbon footprint
• Challenge Renewable energy is intermittent
• One idea (HotPower 2009) Route web requests
  according to the availability of renewables

2
High-End Computing Systems Group An Overview
Department of Computer Science and
Engineering The Ohio State University
3
Why Parallel Computing?

• Traditional Reason High-end applications
• Key enabler of advances in science, engineering,
  and medicine
• Use computational models and simulation to
  replace or supplement experiments
• Very important for society, but a mere drop in
  the ocean of computing, i.e. most of the world
  did not care
• But today, all computers are parallel computers
• Multi-core is mainstream technology
• Disruptive technology has industry in panic
• Huge demand for expertise in parallel systems

4
Multi-Core Computing

• Stanford President John Hennessy when we start
  talking about parallelism and ease of use of
  truly parallel computers, were talking about a
  problem thats as hard as any that computer
  science has faced.
• I would be panicked if I were in
  industry.
• David Patterson At Microsoft in 2005, if you
  said, Hey, what do you guys think about parallel
  computers? they would reply, Who cares about
  parallel computers? We've had 15 or 20 years of
  doubling every 18 months. Get lost.
• You couldn't get anybody's attention inside
  Microsoft by saying that the future was
  parallelism. Now, everybody at Microsoft is
  talking about parallelism.

5
Single Processor Performance Trends
Source J. Birnbaum

• Single-processor performance experienced dramatic
  improvements from 1) clock, and 2) architectural
  improvement (pipelining, Instruction-Level-Paralle
  lism)

5
6
Power Density Trends
1000
Power doubles every 4 years 5-year projection
200W total, 125 W/cm2 !
100
Pentium 4
Pentium III
Pentium II
10
Pentium Pro
Pentium
PVI 75W _at_ 1.5V 50 A!
i386
i486
1
????
??
????
????
?????
?????
?????
?????
????
?????
New Microarchitecture Challenges in the Coming
Generations of CMOS Process Technologies Fred
Pollack, Intel Corp.
7
Processor Clock Frequency Trends

• Processor clock rates increased over 100x in two
  decades, but have now flattened out

Source Deszo Sima
7
8
Moores Law Still Going Strong

• But transistor density continues to rise unabated
• Multiple cores appear to be only option for
  sustained performance growth for everyday
  consumer applications

8
9
Systems Research Areas
Bio-Informatics, Info-Retrieval, Internet
services, Databases and Datamining
Hakan, Srini
Par/Dist Applications
Middleware, Compilers/Runtime Systems, OS,
Dependability and Security
Gagan, Feng, Saday, and Chris
Systems Software
Communication Protocols, Data Access, Multi-core
Architectures
D.K., Radu, and Xiaodong
Arch/Networks/Storage
10
Systems Faculty

• Gagan Agrawal
• Grid Computing, Middleware, Data Mining,
  Biological Data Integration
• Hakan Ferhatosmanoglu
• Databases and Bio-Informatics
• D. K. Panda
• Architecture, Networking, File systems,
  Data-Centers and Virtualization
• Srini Parthasarathy
• Data Mining, Parallel Distributed Computing
  Systems, Bioinformatics
• Feng Qin
• Operating Systems, Security and Dependability

11
Systems Faculty cont.

• P. (Saday) Sadayappan
• Performance Optimization, Compilers/Runtime
  Systems
• Christopher Stewart
• Power management, Data-intensive services,
  Empirical studies
• Radu Teodorescu
• Multicore Computer Architecture, Reliability, Low
  power computing
• Xiaodong Zhang
• Distributed Systems, Memory Systems (also
  Networking)

12
Systems Research Collaboration Cloud Computing
Srini
Han-wei Raghu
Raghu
Gagan
Srini Gagan
Srini
Gagan Radu
Hakan
Saday
Srini
Xiaodong D.K.
Chris
D.K.
13
National Leadership Indicators

• Significant funding from competitive sources
• NSF, DOE, DARPA, NIH
• 6M in PI funding in 2009 alone!
• Strong players in National initiatives (DOE FT,
  DOE Pmodels..)
• Conference leadership
• PC/General Chair ICDCS, IPDPS, SC, Hot IC, ANCS,
  HiPC, LCPC, ICPP, SIAM DM (at CMH 2010)
• VC/Area Chair HPDC, IPDPS, SIGKDD, ICDM
• Editorial leadership
• IEEE TPDS (Associate EIC), Trans Computers,
  Micro JPDC, IEEE Intelligent Systems, IEEE TKDE,
  Data Mining and Knowledge Discovery, Distributed
  and Parallel Databases

14
Deployed Systems and Software

• Clock-Pro page replacement algorithm in Linux
• MVAPICH (975 organizations in 51 countries)
• NFS over RDMA (adopted by Sun)
• Tensor Contraction Engine (NWCHEM Comp. Chemistry
  suite)
• PLuTo Automatic Parallelizer (incorporated in IBM
  xlc compiler)
• Eclat Algorithm used in a host of DB and
  Statistical Analysis tools
• MotifMiner
• LCSTrim Indexing XML Data
• Tree and Graph Mining Suites

15
Systems Area Student Accomplishments

• Over 60 graduate students doing research in the
  Systems area
• Over 40 students funded as RAs
• Publication at premiere conferences (last 5 yrs)
• gt40 papers in top high performance computing
  conf. (e.g., SC, IPDPS, ICS)
• gt30 papers in top data mining conf. (e.g., KDD,
  ICDM, SIAM DM)
• gt15 papers in top database conf. (e.g., ICDE,
  SIGIR, VLDB, SIGMOD, PODS)
• Regular presence at the top ACM and USENIX
  systems conferences (e.g., SIGMETRICS, PPOPP,
  PLDI, PACT, USENIX ATC, ASPLOS, Eurosys, SOSP,
  ISCA)
• 13 Best Paper awards at major conferences over
  last five years, over 20 nominations.

16
Systems Area Student Accomplishments

• Departmental Research award each year for last 5
  years
• Prestigious Fellowship awards
• 5 IBM Fellowships
• 1 Microsoft Research Fellowship
• 2 CRA Computing Innovation Fellowships
• Ph.D. and Masters graduates in great demand
• National Labs Argonne, Oak Ridge, PNNL
• Industry Google, IBM TJ Watson, SGI,
  Compaq/Tandem, Microsoft, Lucent, Citrix, Dell,
  Yahoo, Amazon, Oracle, HP Research, AskJeeves,
  Teradata
• Academia Arizona State University, Louisiana
  State University, University of
  Cincinnati/Cincinnati Childrens Hospital, San
  Francisco State University, Stanford Carnegie
  Institute, U. Iowa, Drexel University.

17
Research Opportunities

• Ph. D. Major area
• Very strong market demand
• Expect continuing demand due to impact on
  foundations as well as technology advances
• Ph.D. Minor area
• Systems cross-cuts many research directions in
  AI, Graphics, Networking, Software Engineering
• Masters Thesis
• Masters Project

18
Relevant Courses
CSE 621
CSE 721
High Perf. Comp.
Architecture
CSE 775
CSE 875
CSE 762
CSE 760
Operating Systems
CSE 671
Databases/ DataMining
CSE 770
CSE 772
CSE 674
CSE 756
Languages/Compilers
CSE 755

• 621 is only offered in Autumn
• 721 is only offered in Winter
• 674, 756, 875 only in Spring (775 in Au/Sp)

19
Specialty Courses

• 788.xxx 3 credit, letter-graded, once in 2 yrs
• 888.xxx S/U graded, every quarter
• Agrawal 788.11I, 888.11I
• Ferhatosmanoglu 788.02H, 888.02H
• Panda 788.08P, 888.08P
• Parthasarathy 788.02G, 888.02J
• Qin 788.06Q and 888.06Q
• Sadayappan 788.11J, 888.11J, 888.11K
• Teodorescu 888.11A, 788.11I
• Stewart 788
• Zhang 788.11Z, 888.11X

20
Summary

• Addressing cutting-edge research challenges with
  focus on multi-disciplinary applications
• Significant research funding from federal,
  industrial and state sources
• Synergistic group with significant growth in the
  last few years
• Many research opportunities for bright and
  motivated students as major area or minor area
  for Ph.D., M.S. thesis, or M.S. project

21
System Group Meetings

• Fridays at 430pm in DL 480
• Broad focus on engaging topics
• Learn about the research of fellow students
• Share and defend your own ideas
• Or stop by and listen as an outsider
• Starting September 25