Technical note Open Access

JOB PACKING: OPTIMIZED CONFIGURATION FOR JOB SCHEDULING

Dal Pra, Stefano


JSON Export

{
  "conceptdoi": "10.15161/oar.it/143356", 
  "conceptrecid": "143356", 
  "created": "2023-11-02T14:55:46.242137+00:00", 
  "doi": "10.15161/oar.it/143357", 
  "files": [
    {
      "bucket": "5fd2de14-6eb8-4ba2-b8fc-af8e83db0557", 
      "checksum": "md5:6bb665129f3afb9c965b54082d9fccfe", 
      "key": "INFN-14-19-CCR.pdf", 
      "links": {
        "self": "https://www.openaccessrepository.it/api/files/5fd2de14-6eb8-4ba2-b8fc-af8e83db0557/INFN-14-19-CCR.pdf"
      }, 
      "size": 899259, 
      "type": "pdf"
    }
  ], 
  "id": 143357, 
  "links": {
    "badge": "https://www.openaccessrepository.it/badge/doi/10.15161/oar.it/143357.svg", 
    "bucket": "https://www.openaccessrepository.it/api/files/5fd2de14-6eb8-4ba2-b8fc-af8e83db0557", 
    "conceptbadge": "https://www.openaccessrepository.it/badge/doi/10.15161/oar.it/143356.svg", 
    "conceptdoi": "https://doi.org/10.15161/oar.it/143356", 
    "doi": "https://doi.org/10.15161/oar.it/143357", 
    "html": "https://www.openaccessrepository.it/record/143357", 
    "latest": "https://www.openaccessrepository.it/api/records/143357", 
    "latest_html": "https://www.openaccessrepository.it/record/143357"
  }, 
  "metadata": {
    "access_right": "open", 
    "access_right_category": "success", 
    "communities": [
      {
        "id": "infn"
      }
    ], 
    "creators": [
      {
        "affiliation": "INFN-CNAF", 
        "name": "Dal Pra, Stefano", 
        "orcid": "0000-0002-1057-2307"
      }
    ], 
    "description": "<p>The default behaviour of a batch system is to dispatch jobs to nodes having the lower<br>\nvalue of some load index. Whilst this causes jobs to be equally distributed among all the<br>\nnodes in the farm, there are cases when different types of behaviour may be desirable, such as<br>\nhaving a completely full node before dispatching jobs to another one, or having similar jobs<br>\ndispatched to nodes already running jobs of the same kind. This work defines the packing<br>\nconcept, different packing policies and useful metrics to evaluate how good the policy is. A<br>\nsimple farm simulator has been written to evaluate the expected impact on a farm of different<br>\npacking policy. The simulator is run against a sequence of real jobs, whose parameters have<br>\nbeen taken from the accounting database of INFN-Tier1. The effectiveness of two packing<br>\npolicies of interest, namely relaxed and exclusive, are compared. The exclusive policy proves<br>\nto be better, at the cost of unused cores in the farm, whose number is estimated. The<br>\npossibility of implementing the exclusive policy on a specific batch system, LSF 7.06, is<br>\nexploited. Relevant configurations are shown and an overall description of the mechanism is<br>\npresented.</p>", 
    "doi": "10.15161/oar.it/143357", 
    "language": "eng", 
    "license": {
      "id": "CC-BY-4.0"
    }, 
    "publication_date": "2014-12-16", 
    "related_identifiers": [
      {
        "identifier": "10.15161/oar.it/143356", 
        "relation": "isVersionOf", 
        "scheme": "doi"
      }
    ], 
    "relations": {
      "version": [
        {
          "count": 1, 
          "index": 0, 
          "is_last": true, 
          "last_child": {
            "pid_type": "recid", 
            "pid_value": "143357"
          }, 
          "parent": {
            "pid_type": "recid", 
            "pid_value": "143356"
          }
        }
      ]
    }, 
    "resource_type": {
      "subtype": "technicalnote", 
      "title": "Technical note", 
      "type": "publication"
    }, 
    "title": "JOB PACKING: OPTIMIZED CONFIGURATION FOR JOB SCHEDULING"
  }, 
  "owners": [
    146
  ], 
  "revision": 2, 
  "stats": {
    "downloads": 0.0, 
    "unique_downloads": 0.0, 
    "unique_views": 0.0, 
    "version_downloads": 0.0, 
    "version_unique_downloads": 0.0, 
    "version_unique_views": 0.0, 
    "version_views": 0.0, 
    "version_volume": 0.0, 
    "views": 0.0, 
    "volume": 0.0
  }, 
  "updated": "2023-11-02T14:56:58.641775+00:00"
}
0
0
views
downloads
All versions This version
Views 00
Downloads 00
Data volume 0 Bytes0 Bytes
Unique views 00
Unique downloads 00

Share

Cite as