CALGARY SAINTS HOCKEY ASSOCIATION EVALUATION MANUAL The objective of the player evaluation process each year is to place hockey players of similar skill levels on the same team. This will ensure that each player will enjoy the game as well as be in a position to develop their hockey skills. We attempt to seed the players in as fair a manner as possible. Movement on teams and from division to division is governed by Minor Hockey deadlines and rules. There are two major issues that one must overcome when doing the evaluations: • Accurately evaluating all the players against each other while only being able to do it 30 at a time. If it was possible, it would be better to evaluate them all at once. • Dealing with the bubble players. These are the players that are on the borderline of making one team or another. This group is usually about 5 or 6 players. Half of which will be the top players on one team and half of which will be the bottom players of the next team up. The results will only be as good as the evaluators that are used. It is very important that they are instructed as to what to look for and how they evaluate. • Our hockey association relies on volunteers for evaluators. Evaluators do not have to be coaches or former coaches to volunteer. However, preference will be given to possible coaches and volunteers who have prior hockey experience. • Parents are welcome to volunteer to evaluate. However, under no circumstances do they evaluate a specific group that includes their son/daughter. For example any ice session, a parent will always be assigned to the sub‐group/ color that does not include their son or daughter. Due to the movement during these sessions, they may be watching the game that includes their son or daughter but they would be evaluating the other group/color that does not include their son or daughter. • An evaluators’ meeting is held prior to the process to instruct the evaluators what the procedure will be, how to mark the sheets, what each category being evaluated means and to sign them up for their times. Evaluators must make their own decisions regarding which players are the highest skilled and lowest skilled. Evaluators should not compare their results with other evaluators. Evaluators should not discuss any results or express and opinions to the parents. The evaluator should offer no comment and direct any questions from parents to the coordinator. • The plan is to end up after four sessions with all of the players sorted and placed into groups of 28 (not counting goalies). Working in groups of 28 or so is very practical as this allows for enough players for the games. In the top group you will want to have only 26 or so. • Each division coordinator will recruit a minimum of 10 evaluators with no maximum that are able to commit to be present during at least 80% of the scheduled evaluations. CONDITIONING Prior to evaluations starting there will be a limited amount of conditioning ice times available to players to participate in at a nominal fee. They are offered this program at registration. BASIC EVALUATION PROCEDURE The numbers of evaluation ice times are preset the season before at the budget meeting. Usually 5 slots are allotted but a minimum of 4 ice slots may be assigned. Doing the initial seeding of players should be as accurate as possible. The players are seeded where they played the previous year in conjunction with previous coach’s player evaluations. In the situation that a player is incorrectly seeded either up or down, move them right away, because their performance may skew the results. The players are evaluated on 4 basic points: skating, playmaking, battle and hockey sense as compared to the group they are skating with. They are rated on a 1 to 10 scale – (10 being strongest, 1 needing most improvement). They are only evaluated on what is being seen on the ice during that ice slot, not what they may or may not have the potential to do. They are evaluated by 3 evaluators each day. By the end of the 4th game session, they will have been evaluated by 12 evaluators. EVALUATION DATA PROCESS THE NUMBERS FOR EACH GAME EVALUATION SLOT WILL BE ENTERED AS SOON AS POSSIBLE TO THAT SLOT ENDING. ¾
¾
¾
¾
¾
¾
¾
The evaluation coordinators will collect the evaluation sheets from the evaluators, and with the divisional coordinators, will enter the data into the provided spreadsheet. The completed session spreadsheet will be printed and placed with that sessions original evaluation sheets and put into a sealed envelope. All evaluation information will then be stored in the Calgary Saints office for reference later if needed. The divisional coordinator or evaluation committee will then ensure the list of attendees for next ice times are sent to the Administration Assistant to post on the website ASAP. Evaluation coordinators will not be involved with any of the processes for the divisions that their own children are being evaluated in. Parents may ask to see their own players scores and will be provided with that information. In no instance can a parent/player be shown to see scores belonging to another player. Parents to be made aware that the results will be posted on the Saints website under their respective division's tab, if a parent does not have access they will need to alert the coordinator so they may be contacted by phone. It will be up to the parents to check the website to see when their child's next skate time will be unless otherwise discusses with divisional coordinator. PLAYER EVALUATIONS ‐ Timbits SKILLS AND DRILLS FOR FIRST 10 MINUTES OF ICE SLOT (not timed) ¾ Group skating from one of the ice to the other ¾ forward weave through pylons REMAINDER OF ICE WILL BE GAME SLOT
¾ On ice selections to be made by potential coaches and other parents deemed qualified ¾ 10 – 12 on ice helpers needed per slot ¾ Participants for the ice times to be determined by their age ‐ 1st year in early slot and 2nd year in later slot. ¾
Coordinator is to try to get as close to equal numbers per slot as possible. If there are too many in 2nd year, try to identify who is playing hockey for the first time and slide them in with the 1st year players. ¾ If a player is identified as too strong (for the 1st year slot) or too weak (for the 2nd) evaluators are to put a piece of coloured tape on their helmet to identify them for the coordinator. ¾ Only children with coloured tape on their helmets will change slots from day to day. A different color is to be use in each slot. ¾ Goal is to have 15 players per team with equal skills PLAYER EVALUATIONS ‐ Novice ‐ Midget FIRST ICE TIME ‐ SKILLS/TIMED DRILLS Player Skills and Timed Drills, except Timbits and Goalies: 1)
2)
3)
4)
5)
Shooting (best out of 10) Skating Forward (time trials) Skating Backwards (time trials) Pylon turns, forwards (time trials) Crossovers, forwards then backwards (Atom‐Midget only) SKILLS AND DRILLS GUIDING PRINCIPLES: ¾ At least two evaluators per each skills and drills station ¾ Players are seeded where they played the previous year and will be set up in equal numbered groups based upon the number of players in that age division and ice slots available. ¾ Each player will be given up to two attempts to complete the skill/drill (time allowing) run though all skill/drills allowing all players to complete each drill then repeat cycle. ¾ All players will do the same drill regardless of preferred position (Forward vs. Defence) ¾ Evaluation coordinator will verbally provide to the players, prior to them going on ice, what is expected of them and which station they will proceed too. ¾ All groups will rotate in a clockwise rotation. ¾ Once all players have complete the skills and drills they will leave the ice. ¾ Players best times should give them a ranking at the end of the first ice time. (ie: if 100 kids in age division then should be ranked 1‐100) Rankings will be averaged giving one general ranking for all skills/drills. SECOND ICE TIME ‐ GAME EVALUATIONS Game Evaluations Guiding principles: ¾
Prior to the start of any games one of the Evaluation Committee members will make an announcement in the dressing advising all present (parents/players) on how the game evaluation will be handled. o This will include ice time per shift o No double shifting of players o Players will play their positions (forward vs. defence) as best possible o Explain when/if a player will be removed from the ice ¾
¾
¾
¾
¾
¾
¾
¾
¾
¾
¾
¾
At least 30 minutes prior to each game the evaluation committee coordinator needs to meet with all non‐ice evaluators to go over the evaluation forms and so they understand the expectations. Only those persons who have been deemed by the evaluation committee as qualified may participate. Each non ice evaluator will evaluate a minimum of ten (10) players per ice time. Between 8 to 10 off‐ice evaluators per ice time. Evaluators cannot compare notes or exchange information while evaluating. Evaluators are to be secluded from the parents during the entire evaluation process. A section of the stands will be roped off and they will do evaluating from that area. The divisional coordinator will keep parents away. 2 persons required per each game to operate the bench doors. A persons will be excluded from assisting with bench duties, if their child is on that bench. No coaching is allowed from the bench or the stands. Time clock will be set to for shifts of 90 sec. When the buzzer sounds player will leave the puck where it is and proceed back to their bench so that the next line can go out. For Atom and above, if possible, sort the players based on position (Forward vs. Defence). Ensure up to 9 Forwards and 6 Defence per team as best possible. A player may be moved from their current game Group: if during the game, an evaluator identifies an individual(s) whom they believe, based on the players game evaluation, is playing above or below their skill level. This will generally happen at the beginning of the ice slot. o The evaluation committee will ask that the player be removed from the ice and will be sent to the dressing room. The committee member with advise the player and their parents of the reason for the removal from the ice. The committee will as soon as possible identify o Top 6‐9 forwards in each age group based on skill level o Top 4‐6 defence in each age group based on skill level The second ice time organizes the players based on the evaluation results of the skills session. The players will be split based upon the available ice and the number of players enrolled. This split shall be done solely based upon the rankings in the skills session such that, for example, if there are 4 ice times and 100 kids the top 25 would skate together in this ice time, players ranked 26 through 50 would skate together in this ice time 51 through 75 would skate together and those ranked 76 through 100 would skate together. This ice time will be also be a game situation. This allows a player to be compared with players in skill levels up to two groups above their current position. Players are moved as required one level up or down. In all cases the players that move up are those are those with the highest scores. Also one looks for breaks in the scores between the last one graduated up and the first one not moved. (Example – if two players scores are tied, the cut would be made either before these two or after these two). Player movement is done solely to accumulate information that is used in the player placement process. It is in no way an indication of which team a player will be placed. THIRD ICE TIME ‐ GAME EVALUATIONS By this time the evaluations are becoming generally consistent for groups at the very top or bottom. The third ice time will continue to mix the levels in order to test the ratings to date and to expose initially lower ranked players to higher ranked players. ¾ Players are moved as required one level up or down. ¾ Players in group 3 should do very well against their comparative group 4, while the players in 4 should generally look mismatched against group 1 and 2. Thus only the very top level performers in 4 should be moved up to 3 while only the poorest 3’s should be moved to 4. ¾ At the end of this session the Division Coordinators and evaluation committee should identify the core members of the teams to allow identification of potential team coaches. FOURTH AND FIFTH ICE TIMES ‐ Game Evaluations (Bubble Players) For the 4th session the focus of this evaluation would be identifying the bubble players or players close to making one team or another: top or bottom players for each age group and team assignment. If the evaluation committee and divisional coordinator has identified player(s) who’s combined evaluation score/ranking is far superior or significantly below others in that same group or team, then the evaluation committee and coordinator can excuse them from taking part in the remainder evaluation process. This should only be done where there is a specific need to open ice up to allow those individuals more ice time. THOSE PLAYERS THAT HAVE BEEN EXCUSED ARE ASKED TO NOT BE AT THE ARENA UNDER ANY CIRCUMSTANCES DURING THE REMAINDER OF THE PROCESS. All that remains is dividing the groups into two teams. On ice coaches should run a controlled scrimmage to give the players a game atmosphere for the final evaluation. The on ice coach will call for the number of players to be let out at a time, 5 on 5, 4 on 4, 3 on 3. This will help to high‐light player’s strengths and weaknesses and give the evaluators sufficient time to observe the various bubble players. If it is determined by the committee/divisional coordinator that there are not enough of either position (forward or defense) left on ice after the exclusions to make a fair game then the excused players will be asked to play, but they will not be evaluated for that ice time thus allowing the evaluators to focus on the bubble players. When scores are even, a tie breaking criteria must be applied, the divisional coordinator and evaluation committee will look at the following criteria for each player before making the decision: ¾ Skills/Drills evaluation times ¾ Comments from Evaluators (drive, attitude, commitment, hockey sense, positioning etc) ¾ Player position – defensemen versus forward – ensuring teams have both. ¾ Coaches pick (Coordinator and committee will discuss with the coaching candidates for intended teams) All players in Pee Wee, Bantam and Midget age categories must identify upon registration whether they will be evaluated as forwards or defensemen. ¾ Age: returning category players may be given preference over first year players due to maturity. GOALIE EVALUATIONS Goalie Skills and Drills operating factors: ¾ At least two evaluators per each skills and drills station ¾ Players are seeded where they played the previous year. ¾ Each player will be given up to two attempts to complete the skill/drill (time allowing) run though all skill/drills then repeat cycle. ¾ Goalies are evaluated on positioning, athleticism/reaction, aggressiveness/control, performance & awareness GOALIE SKILLS/DRILLS: 1) Athleticism/Reaction time ‐ Read, React and Lateral Movement ¾ two skaters passing back and forth then take shot on goalie (5‐10 attempts) 2) Aggressiveness/Control ‐ Selection, Execution and rebound Control ¾ 2 skaters, 1 shoots the other takes rebound (10 attempts) ¾ 2 skaters, 1 shoots the other screens (10 attempts) 3) Performance and Awareness ‐ Anticipation, Stance, Positioning and Balance ¾ 3 players to shoot 5 shots on net, first stationary and then 5 shots while skating (wrist/ slapshot or deke) ¾ 2 on 1 4) Mobility/Positioning ‐ Skating, Stick Handling, Mechanics and Endurance ¾ Goalie will receive moving puck shot down boards behind net, will shoot puck back up boards and reset in playing position to receive 2 shots each from 3 shooters. Repeat from opposite side of rink. FOR ALL GOALIE DRILLS POSITIONING, AWARENESS AND RECOVERY WILL BE EVALUATED All goalies will be evaluated in games and a skills goalie session. Separate evaluators are necessary for this position. The selection process for goalies is very dependent on the number of goalies available for each age group. Therefore the selection process needs to have some flexibility. For the goalie skills evaluation session, use a few stations on ice with a few drills at each. On ice coaches are necessary. Drills are selected that test all of the important aspects of goaltending. Things like the shuffle, angling, T‐push, dropping, recovery, goal post play, glove hand and stick saves, puck control, agility and technique. Players with good shots are needed to help with the shooting drills. Bases on these preliminary sessions, goalies will be assigned to the initial player sessions most suited for their ability. The top ranked goalies will be assigned to the top player group. Goalies with similar scores or rankings should be placed in the same game and have experienced goaltender evaluators evaluating them. Designation of goaltenders in Peewee to Midget age groups is mandatory on the official Hockey Calgary rosters. Designation of goaltenders in the Atom Age Group of the official Hockey Calgary roster will be assessed on an annual basis by the Calgary Saints Board of Directors and will be decided based on such information as the number of players registering as goaltenders, the commitment level of goaltenders etc. It is important for goalies to be aware, that when they elect to evaluate at the goaltender position, they will be expected to remain at that position through the balance of the year. Exceptions may apply for the Atom Age Group only. Once players are designated as goaltenders on teams that have been registered with Hockey Calgary, those players can no longer perform as a skater. The number of goaltenders per team will vary depending on the number of eligible candidates and the number of teams in a particular age group. If registration numbers allow, 2 (two) goaltenders will be placed on each team. Following the pre‐evaluation sessions, The Saints will indicate to goaltenders whether or not they can reasonably expect to be placed on a team as a goaltender. In instances where it is likely that a goaltender will not be placed on a team, the parents will be informed so that the goaltender can be evaluated as a player, or elect to be released to another association as a goaltender. This will only occur when there are more goalies interested in playing the position than there are positions available on teams within the age group. If the registration numbers indicate that there will not be 2 (two) goaltenders per team, then it will be up to the discretion of the Evaluation Team to determine which team(s) should be allotted only 1 (one) goalie. ALL TEAM SELECTIONS WILL BE REVIEWED AND APPROVED BY THE CALGARY SAINTS EXECUTIVE BOARD PRIOR TO PLAYERS BEING NOTIFIED OF THEIR PLACEMENTS. SPECIAL SITUATIONS • At the Bantam and Midget level, those players that are unable to participate in evaluations because they are still being considered for quadrant, will have a spot left open to them on Team 1. As most of the quadrant cuts will be done before we start, there should only be a few spots required. •
When a player is transferred from another association within the city, then use last year’s level as a basis for the initial seeding. For players coming from out of town, try to determine how many years the player has played then place him in an average group of that level. EVALUATION ATTENDANCE Players must attend all evaluation ice sessions. It is the parent’s responsibility to contact the division coordinator prior to their assigned ice times with a valid reason he/she will be absent. In the event that a player elects to simply not show up for a session and no notification or valid reason is given then that player will receive a score of zero for that particular ice time. This will have the effect of lowering their overall final ranking which may jeopardize the team they ultimately will be placed on. Legitimate Personal, Family and Medical Emergencies are situations where a Coordinator will generally not count that day in the final player ranking. Each particular case will be reviewed separately to help determine the best course of action. If a player becomes injured or sick during and is unable to attend any of the evaluation sessions for the upcoming year, the parents of the player must contact the age group coordinator directly to provide medical documentation and explain the situation. The player may be placed in a group based on the prior year’s coaching evaluation. All decisions regarding placement will be done in collaboration between the division coordinator and evaluation appeals committee. On occasion, there will be a disgruntled parent. If they present their concern in a reasonable manner, then they can initiate the Calgary Saints Evaluation Appeals Process. The parent should be shown the number range of group above their son/daughter and below but no names. The coaches are also asked to watch their players over the next 2 weeks to see if there are any players that stand out either way, remembering there is a range of players on each team. If at this time a player clearly appears to be misplaced then the coach and division coordinator should discuss the potential movement of such player. Every effort should be made to explain the situation to the player’s parents. That according to their skill level and evaluation scores this is where there Son/daughter was seeded but the players skill level is not there for this particular division. We feel that it would be in the best interest of the player that he/she be moved to ensure that the player will have a better hockey experience and to play at the proper skill level for optimal development. Movement will still be done if Coaches, Coordinator or Appeals Committee feel that the player may not belong on that team. This is solely at the discretion of the association. There will be no player movement after December 1st. Any parent that has multiple sons or daughters in a given/same age group may request to have these family members placed together. These players will be allowed to play only in the lowest tier that one of the players/family members were placed after evaluations. The players can only move if they are within one team of each other and only down. EVALUATION DAY(S) Equipment – pucks, evaluation sheets, day sheets, helmet stickers, goalie equipment, pylons, clipboards, pencils, group lists for the doors, envelopes and stop watches. Personnel – Coordinator and Committee member – assistants, statistician, evaluators, bench coaches, timekeepers, referees (where needed), warm up leader, on ice coaches. Players ‐ to check in at their divisions table upon arrival and have their evaluation number assigned to them. Players will be directed to a specific dressing room for that day. COORDINATORS/COMMITTEE ¾ Fill out evaluation forms for evaluators with numbers only and ensure each player is being evaluated by at least three different evaluators. Coordinators to make sure there are no duplicated numbers. ¾ Make sure the parents are aware their player will have the same number throughout the evaluation and DO NOT REMOVE the sticker from their child's helmet until the end of the last evaluation. ¾ Parents to be made aware that the results will be posted on the Saints website under their respective division's tab, if a parent does not have access they will need to alert the coordinator so they may be contacted by phone. IT WILL BE UP TO THE PARENTS TO CHECK THE WEBSITE TO SEE WHEN THEIR CHILD'S NEXT SKATE TIME WILL BE. FAMILY RESPONSIBILITIES ¾ BE AWARE OF THE IMPORTANCE OF EVALUATIONS AND THE CORRESPONDING SCHEDULES. Please respect that September is the primary month for evaluations, and that players are required to attend all scheduled sessions. Missed sessions may alter the process for all players. Consult the Saints Hockey Association website frequently, and if you are ever unclear about anything regarding the process, refer to this manual or contact your Divisional Coordinator or Evaluation Committee member as soon as possible. ¾ HELP YOUR CHILD BE PREPARED. Be at the rink early enough for your child to be completely ready at least 15 minutes before the ice time starts. Players should be dressed and sitting on the benches in the dressing room with their sticks at the door. Make sure all their equipment fits, skates are sharpened and everything is in the equipment bag when you leave your home. Full equipment including neck and mouth guards are mandatory and must be in place for your child to participate in the evaluation process. ¾ HELP YOUR CHILD TO STAY POSITIVE AND TO ALWAYS TRY THEIR BEST. Help them to understand the process: movement and how it works. Movement is required to be able to compare different groups of skaters with each other to ensure everyone has a chance to show where they fit. ¾ UNDERSTAND THE PROCESS YOURSELF. Be as informed as possible about the associations, both Saints Hockey and Hockey Calgary, and the evaluation process. ¾ CONTACT SAINTS HOCKEY ASSOCIATION EARLY IF YOU HAVE A CONCERN OR QUESTION ¾ CONTACT SAINTS HOCKEY ASSOCIATION EARLY IF YOUR CHILD IS SICK OR INJURED. ¾ Contact the divisional coordinator directly by email (contact information can be found on the Saints website) ¾ RESPECT OUR EVALUATORS. Do not sit by an Evaluator, ask evaluators for player information or interfere with the evaluator’s efforts to watch all the players on the ice. ¾ MAKE SURE YOUR PLAYER HAS FUN!