Technology Watch

From HP-SEE Wiki

Revision as of 08:22, 2 April 2012 by Roczei (Talk | contribs)
Jump to: navigation, search

Contents

Technology watch methodology

Introduction

The task of the Technology Watch is to observe, track, filter out and assess potential technologies from a very wide field extending beyond the normal confines of the sector. A Technology Watch process can be broken down into four main phases: a needs audit, data collection, processing of the data collected and integration and dissemination of the results. The Technology Watch process must be capable of identifying any scientific or technical innovation with potential to create opportunities or avoid threats.

Objectives of technology watch

Study and follow the latest trends and advances in technology both in terms of software and programming as well as in terms of hardware and procurement. On the one hand, new architectures and system designs are constantly released by the vendors of top systems, some more suited for particular user communities than others. On the other hand, new software technologies and paradigms, like cloud computing, general purpose GPU computing, etc. emerge from research or industrial efforts. This leads to a naturally heterogeneous distributed HPC infrastructure, and WP8 will establish permanent technology watch to cater for regional user needs. To facilitate this, the project will develop links with PRACE, the industry, and follow the advances in research and developments of HPC systems via scientific conferences and journals.

Technological areas

Methodology

  • Organize meetings with vendors

Since the beginning of the project several 1 hour meetings have been organized with vendors and appended to the regular PSC meetings of the consortium. This is to continue in the remaining of the project.

  • Ask vendors to fill our survey

This questionnaire is intended to help polling HPC hardware vendors to determine the most important technical trends that they sense in the HPC area. These trends are accumulated, analyzed and then synthesized into an uniform report. The polls will be repeated periodically in order to follow up the most relevant novelties that might impact the near future of HPC.

Vendor survey URL: http://survey.ipb.ac.rs/index.php?sid=82412&lang=en

  • Collect know-hows from other projects

The public deliverables of relevant projects (DEISA, PRACE, EGI, EMI, etc.) may content useful information for our work packages.

  • Participate on SC/ISC conferences and write digest about the new technical solutions which has been discovered. These summaries should be created about those technological areas which have been defined
  • The evaluation and dissemination of the new technologies can be done by using the hp-see-tech@lists.hp-see.eu mailing list and http://hpseewiki.ipb.ac.rs/index.php/Technology_Watch wiki page
  • Participation in STRATOS (The PRACE Advisory Group for Strategic Technologies) group work. STRATOS is open to consortia of industry and research institutions as well as members from industrial and non-industrial European research and development projects. This will be done by PRACE HPC partners (IPB, GRNET, NIIFI) at the beginning and later we will try do this by PRACE/HP-SEE MoU.
  • Liaise with PRACE AISBL (Association International Sans But Lucratif) and include in the related MoU the possibility access the technology watch information that is generated within PRACE

Implementation plan

Involved in this work

  • ICCT-BAS
  • IPB
  • GRNET
  • NIIFI (Gabor Roczei will coordinate this task)
  • IFIN-HH

Action plan

ID Task Responsible partner State Delivery date
1 Participate on SC 2012 conference (10-16 November 2012, Salt Lake City, Utah) and create technical digest  ? NEW M27 (November 2012)
2 Participate on ISC 2012 conference (17-21 June 2012, Hamburg, Germany) and create technical digest  ? NEW M22 (June 2012)
3 Participate on conference and create technical digest All partners NEW M31 (March 2013)
4 Technology watch in this area: Tools and libraries IPB, ICCT-BAS, IFIN-HH NEW M31 (March 2013)
5 Technology watch in this area: New programming languages and models IFIN-HH, GRNET NEW M31 (March 2013)
6 Technology watch in this area: System software, middleware and programming environments NIIFI, ICCT-BAS NEW M31 (March 2013)
7 Technology watch in this area: Green HPC (energy efficiency, cooling) ICCT-BAS, IPB NEW M31 (March 2013)
8 Technology watch in this area: Processor architectures (CPU, GPU) GRNET, IFIN-HH NEW M31 (March 2013)
9 Technology watch in this area: Interconnect technologies ICCT-BAS, IPB NEW M31 (March 2013)
10 Technology watch in this area: Memory and storage units IFIN-HH, NIIFI NEW M31 (March 2013)
11 STRATOS participation as PRACE member IPB, GRNET, NIIFI NEW M31 (March 2013)
12 Ask vendors to fill our survey All partners NEW M31 (March 2013)
13 Finalize the MoU with PRACE which include the PRACE technology watch access GRNET NEW M22 (June 2012)
14 Organize meetings with vendors All partners NEW M31 (March 2013)

Time plan until the end of the project

  • Plans for 2012
    • Participation in STRATOS working group
    • Ask more vendors to fill our survey
    • Organize meetings with vendors
    • Creation of technical digests about the visited conferences
    • Finalize PRACE MoU trying to include the technology watch task
  • Plans for 2013
    • Participation in STRATOS working group
    • Ask more vendors to fill our survey
    • Continue meetings with vendors
    • Creation of technical digests about the visited conferences
    • D8.3 Permanent technology watch report (delivery date: M31)
      • Responsible: Emanouil Atanassov (ICCT-BAS)

Planned conferences in 2012 

Which partner will participate: ?
Which partner will participate: ?

Conclusions

The technology watch is a complex task where we need to follow up several technological areas. These has been described above. If somebody will participate on SC/ISC conferences then he/she need to write a technical digest about the new technical solutions which have been discovered and these summaries should be created about those technological areas which have been defined. The dissemination can be done by using the hp-see-tech mailing list and HP-SEE wiki. The new HPC trends will be collected from the vendors over that survey which has been created for this purpose.

Collected materials

Other projects

Technical digests about the visited conferences 

Please document here

Vendor responses about technical trends

HPC architecture (Commodity Cluster, Custom based solutions (mainframe)

We are sensing that the difference between the classic mainframe based resources (SMPs, NUMA systems) and the PC-based clusters has been dissolving as technological elements are mutually transferred between the two.

  • How do you see this trend?
    • Vendor 1: Yes, agree. However, this trend will reach its limit in future.
  • Do you think that the clustered environments will replace the classic mainframe models?
    • Vendor 1: PC-based clusters will not be able to replace classic mainframe resources at least for the next 5 years. Both will be always needed for certain environments.
  • Or do you think that the classic mainframe architectures will survive within the multi-core server architectures?
    • Vendor 1: Yes, classic mainframe architectures will survive within the multi-core server architectures because mainframe resources also implement such technologies.

Processor architectures (CPU, GPU)

The average number of cores in nodes has been increasing.

  • Do you think that this trend will continue in the future?
    • Vendor 1: Yes, definitely.
  • What do you think to be the largest core number in a single server in a year?
    • Vendor 1: 96
  • Do you think that the increasing number of cores will not contribute to the performance increase sufficiently?
    • Vendor 1: Increasing number of cores will contribute to the performance increase sufficiently.
  • Do you think that AMD and Intel will dominate the HPC market?
    • Vendor 1: Yes.
  • Do you think that the graphics processors will keep representing an increasing share in the CPU portfolio?
    • Vendor 1: Yes, but this inclrese will go slower.

Interconnect technologies

  • What do you think to be the most dominant interconnection platform in HPC?
    • Vendor 1: Infiniband

Operating system

HPC is traditionally performed in Linux/Unix environments. Nevertheless Microsoft keeps pushing in this area as well.

  • Do you think that the amount of MS Windows operated centers will increase in the future?
    • Vendor 1: Not much.
  • Do you think that Linux will outperform other Unix solutions in this field?
    • Vendor 1: Yes.

Virtualization

IaaS clouds are used for decoupling operating systems from the physicalhardware.

  • Do you think that such virtualization technologies will show up in HPC to use the hardware platforms more efficiently?
    • Vendor 1: Yes, they will.

Energy efficiency

While 10 years ago it was even a marginal question how much power is needed to run a site, today it is one of the most important price factors parallel to the initial cost. Water cooling helps saving 10-30% of the energy spent on the operating environment, thus different forms of water cooling (racks, server rooms, cooling towers) have begun to appear. Other forms of energy savings are also supported, such as self-standby operations, and power limitations on CPUs.

  • Do you think that water cooling will gain significance in the future data centers?
    • Vendor 1: Yes, but price will be the driving component to what extend water cooling will gain significance.

Useful links

Retrieved from "http://hpseewiki.ipb.ac.rs/index.php/Technology_Watch"
Personal tools