xref: /openbsd-src/gnu/usr.bin/perl/pod/perltie.pod (revision 3d61058aa5c692477b6d18acfbbdb653a9930ff9)
1=head1 NAME
2X<tie>
3
4perltie - how to hide an object class in a simple variable
5
6=head1 SYNOPSIS
7
8 tie VARIABLE, CLASSNAME, LIST
9
10 $object = tied VARIABLE
11
12 untie VARIABLE
13
14=head1 DESCRIPTION
15
16Prior to release 5.0 of Perl, a programmer could use dbmopen()
17to connect an on-disk database in the standard Unix dbm(3x)
18format magically to a %HASH in their program.  However, their Perl was either
19built with one particular dbm library or another, but not both, and
20you couldn't extend this mechanism to other packages or types of variables.
21
22Now you can.
23
24The tie() function binds a variable to a class (package) that will provide
25the implementation for access methods for that variable.  Once this magic
26has been performed, accessing a tied variable automatically triggers
27method calls in the proper class.  The complexity of the class is
28hidden behind magic methods calls.  The method names are in ALL CAPS,
29which is a convention that Perl uses to indicate that they're called
30implicitly rather than explicitly--just like the BEGIN() and END()
31functions.
32
33In the tie() call, C<VARIABLE> is the name of the variable to be
34enchanted.  C<CLASSNAME> is the name of a class implementing objects of
35the correct type.  Any additional arguments in the C<LIST> are passed to
36the appropriate constructor method for that class--meaning TIESCALAR(),
37TIEARRAY(), TIEHASH(), or TIEHANDLE().  (Typically these are arguments
38such as might be passed to the dbminit() function of C.) The object
39returned by the "new" method is also returned by the tie() function,
40which would be useful if you wanted to access other methods in
41C<CLASSNAME>. (You don't actually have to return a reference to a right
42"type" (e.g., HASH or C<CLASSNAME>) so long as it's a properly blessed
43object.)  You can also retrieve a reference to the underlying object
44using the tied() function.
45
46Unlike dbmopen(), the tie() function will not C<use> or C<require> a module
47for you--you need to do that explicitly yourself.
48
49=head2 Tying Scalars
50X<scalar, tying>
51
52A class implementing a tied scalar should define the following methods:
53TIESCALAR, FETCH, STORE, and possibly UNTIE and/or DESTROY.
54
55Let's look at each in turn, using as an example a tie class for
56scalars that allows the user to do something like:
57
58    tie $his_speed, 'Nice', getppid();
59    tie $my_speed,  'Nice', $$;
60
61And now whenever either of those variables is accessed, its current
62system priority is retrieved and returned.  If those variables are set,
63then the process's priority is changed!
64
65We'll use Jarkko Hietaniemi <F<jhi@iki.fi>>'s BSD::Resource class (not
66included) to access the PRIO_PROCESS, PRIO_MIN, and PRIO_MAX constants
67from your system, as well as the getpriority() and setpriority() system
68calls.  Here's the preamble of the class.
69
70    package Nice;
71    use Carp;
72    use BSD::Resource;
73    use strict;
74    $Nice::DEBUG = 0 unless defined $Nice::DEBUG;
75
76=over 4
77
78=item TIESCALAR classname, LIST
79X<TIESCALAR>
80
81This is the constructor for the class.  That means it is
82expected to return a blessed reference to a new scalar
83(probably anonymous) that it's creating.  For example:
84
85 sub TIESCALAR {
86     my $class = shift;
87     my $pid = shift || $$; # 0 means me
88
89     if ($pid !~ /^\d+$/) {
90         carp "Nice::Tie::Scalar got non-numeric pid $pid" if $^W;
91         return undef;
92     }
93
94     unless (kill 0, $pid) { # EPERM or ERSCH, no doubt
95         carp "Nice::Tie::Scalar got bad pid $pid: $!" if $^W;
96         return undef;
97     }
98
99     return bless \$pid, $class;
100 }
101
102This tie class has chosen to return an error rather than raising an
103exception if its constructor should fail.  While this is how dbmopen() works,
104other classes may well not wish to be so forgiving.  It checks the global
105variable C<$^W> to see whether to emit a bit of noise anyway.
106
107=item FETCH this
108X<FETCH>
109
110This method will be triggered every time the tied variable is accessed
111(read).  It takes no arguments beyond its self reference, which is the
112object representing the scalar we're dealing with.  Because in this case
113we're using just a SCALAR ref for the tied scalar object, a simple $$self
114allows the method to get at the real value stored there.  In our example
115below, that real value is the process ID to which we've tied our variable.
116
117    sub FETCH {
118        my $self = shift;
119        confess "wrong type" unless ref $self;
120        croak "usage error" if @_;
121        my $nicety;
122        local($!) = 0;
123        $nicety = getpriority(PRIO_PROCESS, $$self);
124        if ($!) { croak "getpriority failed: $!" }
125        return $nicety;
126    }
127
128This time we've decided to blow up (raise an exception) if the renice
129fails--there's no place for us to return an error otherwise, and it's
130probably the right thing to do.
131
132=item STORE this, value
133X<STORE>
134
135This method will be triggered every time the tied variable is set
136(assigned).  Beyond its self reference, it also expects one (and only one)
137argument: the new value the user is trying to assign. Don't worry about
138returning a value from STORE; the semantic of assignment returning the
139assigned value is implemented with FETCH.
140
141 sub STORE {
142     my $self = shift;
143     confess "wrong type" unless ref $self;
144     my $new_nicety = shift;
145     croak "usage error" if @_;
146
147     if ($new_nicety < PRIO_MIN) {
148         carp sprintf
149           "WARNING: priority %d less than minimum system priority %d",
150               $new_nicety, PRIO_MIN if $^W;
151         $new_nicety = PRIO_MIN;
152     }
153
154     if ($new_nicety > PRIO_MAX) {
155         carp sprintf
156           "WARNING: priority %d greater than maximum system priority %d",
157               $new_nicety, PRIO_MAX if $^W;
158         $new_nicety = PRIO_MAX;
159     }
160
161     unless (defined setpriority(PRIO_PROCESS,
162                                 $$self,
163                                 $new_nicety))
164     {
165         confess "setpriority failed: $!";
166     }
167 }
168
169=item UNTIE this
170X<UNTIE>
171
172This method will be triggered when the C<untie> occurs. This can be useful
173if the class needs to know when no further calls will be made. (Except DESTROY
174of course.) See L</The C<untie> Gotcha> below for more details.
175
176=item DESTROY this
177X<DESTROY>
178
179This method will be triggered when the tied variable needs to be destructed.
180As with other object classes, such a method is seldom necessary, because Perl
181deallocates its moribund object's memory for you automatically--this isn't
182C++, you know.  We'll use a DESTROY method here for debugging purposes only.
183
184    sub DESTROY {
185        my $self = shift;
186        confess "wrong type" unless ref $self;
187        carp "[ Nice::DESTROY pid $$self ]" if $Nice::DEBUG;
188    }
189
190=back
191
192That's about all there is to it.  Actually, it's more than all there
193is to it, because we've done a few nice things here for the sake
194of completeness, robustness, and general aesthetics.  Simpler
195TIESCALAR classes are certainly possible.
196
197=head2 Tying Arrays
198X<array, tying>
199
200A class implementing a tied ordinary array should define the following
201methods: TIEARRAY, FETCH, STORE, FETCHSIZE, STORESIZE, CLEAR
202and perhaps UNTIE and/or DESTROY.
203
204FETCHSIZE and STORESIZE are used to provide C<$#array> and
205equivalent C<scalar(@array)> access.
206
207The methods POP, PUSH, SHIFT, UNSHIFT, SPLICE, DELETE, and EXISTS are
208required if the perl operator with the corresponding (but lowercase) name
209is to operate on the tied array. The B<Tie::Array> class can be used as a
210base class to implement the first five of these in terms of the basic
211methods above.  The default implementations of DELETE and EXISTS in
212B<Tie::Array> simply C<croak>.
213
214In addition EXTEND will be called when perl would have pre-extended
215allocation in a real array.
216
217For this discussion, we'll implement an array whose elements are a fixed
218size at creation.  If you try to create an element larger than the fixed
219size, you'll take an exception.  For example:
220
221    use FixedElem_Array;
222    tie @array, 'FixedElem_Array', 3;
223    $array[0] = 'cat';  # ok.
224    $array[1] = 'dogs'; # exception, length('dogs') > 3.
225
226The preamble code for the class is as follows:
227
228    package FixedElem_Array;
229    use Carp;
230    use strict;
231
232=over 4
233
234=item TIEARRAY classname, LIST
235X<TIEARRAY>
236
237This is the constructor for the class.  That means it is expected to
238return a blessed reference through which the new array (probably an
239anonymous ARRAY ref) will be accessed.
240
241In our example, just to show you that you don't I<really> have to return an
242ARRAY reference, we'll choose a HASH reference to represent our object.
243A HASH works out well as a generic record type: the C<{ELEMSIZE}> field will
244store the maximum element size allowed, and the C<{ARRAY}> field will hold the
245true ARRAY ref.  If someone outside the class tries to dereference the
246object returned (doubtless thinking it an ARRAY ref), they'll blow up.
247This just goes to show you that you should respect an object's privacy.
248
249    sub TIEARRAY {
250      my $class    = shift;
251      my $elemsize = shift;
252      if ( @_ || $elemsize =~ /\D/ ) {
253        croak "usage: tie ARRAY, '" . __PACKAGE__ . "', elem_size";
254      }
255      return bless {
256        ELEMSIZE => $elemsize,
257        ARRAY    => [],
258      }, $class;
259    }
260
261=item FETCH this, index
262X<FETCH>
263
264This method will be triggered every time an individual element the tied array
265is accessed (read).  It takes one argument beyond its self reference: the
266index whose value we're trying to fetch.
267
268    sub FETCH {
269      my $self  = shift;
270      my $index = shift;
271      return $self->{ARRAY}->[$index];
272    }
273
274If a negative array index is used to read from an array, the index
275will be translated to a positive one internally by calling FETCHSIZE
276before being passed to FETCH.  You may disable this feature by
277assigning a true value to the variable C<$NEGATIVE_INDICES> in the
278tied array class.
279
280As you may have noticed, the name of the FETCH method (et al.) is the same
281for all accesses, even though the constructors differ in names (TIESCALAR
282vs TIEARRAY).  While in theory you could have the same class servicing
283several tied types, in practice this becomes cumbersome, and it's easiest
284to keep them at simply one tie type per class.
285
286=item STORE this, index, value
287X<STORE>
288
289This method will be triggered every time an element in the tied array is set
290(written).  It takes two arguments beyond its self reference: the index at
291which we're trying to store something and the value we're trying to put
292there.
293
294In our example, C<undef> is really C<$self-E<gt>{ELEMSIZE}> number of
295spaces so we have a little more work to do here:
296
297 sub STORE {
298   my $self = shift;
299   my( $index, $value ) = @_;
300   if ( length $value > $self->{ELEMSIZE} ) {
301     croak "length of $value is greater than $self->{ELEMSIZE}";
302   }
303   # fill in the blanks
304   $self->STORESIZE( $index ) if $index > $self->FETCHSIZE();
305   # right justify to keep element size for smaller elements
306   $self->{ARRAY}->[$index] = sprintf "%$self->{ELEMSIZE}s", $value;
307 }
308
309Negative indexes are treated the same as with FETCH.
310
311=item FETCHSIZE this
312X<FETCHSIZE>
313
314Returns the total number of items in the tied array associated with
315object I<this>. (Equivalent to C<scalar(@array)>).  For example:
316
317    sub FETCHSIZE {
318      my $self = shift;
319      return scalar $self->{ARRAY}->@*;
320    }
321
322=item STORESIZE this, count
323X<STORESIZE>
324
325Sets the total number of items in the tied array associated with
326object I<this> to be I<count>. If this makes the array larger then
327class's mapping of C<undef> should be returned for new positions.
328If the array becomes smaller then entries beyond count should be
329deleted.
330
331In our example, 'undef' is really an element containing
332C<$self-E<gt>{ELEMSIZE}> number of spaces.  Observe:
333
334    sub STORESIZE {
335      my $self  = shift;
336      my $count = shift;
337      if ( $count > $self->FETCHSIZE() ) {
338        foreach ( $count - $self->FETCHSIZE() .. $count ) {
339          $self->STORE( $_, '' );
340        }
341      } elsif ( $count < $self->FETCHSIZE() ) {
342        foreach ( 0 .. $self->FETCHSIZE() - $count - 2 ) {
343          $self->POP();
344        }
345      }
346    }
347
348=item EXTEND this, count
349X<EXTEND>
350
351Informative call that array is likely to grow to have I<count> entries.
352Can be used to optimize allocation. This method need do nothing.
353
354In our example there is no reason to implement this method, so we leave
355it as a no-op. This method is only relevant to tied array implementations
356where there is the possibility of having the allocated size of the array
357be larger than is visible to a perl programmer inspecting the size of the
358array. Many tied array implementations will have no reason to implement it.
359
360    sub EXTEND {
361      my $self  = shift;
362      my $count = shift;
363      # nothing to see here, move along.
364    }
365
366B<NOTE:> It is generally an error to make this equivalent to STORESIZE.
367Perl may from time to time call EXTEND without wanting to actually change
368the array size directly. Any tied array should function correctly if this
369method is a no-op, even if perhaps they might not be as efficient as they
370would if this method was implemented.
371
372=item EXISTS this, key
373X<EXISTS>
374
375Verify that the element at index I<key> exists in the tied array I<this>.
376
377In our example, we will determine that if an element consists of
378C<$self-E<gt>{ELEMSIZE}> spaces only, it does not exist:
379
380 sub EXISTS {
381   my $self  = shift;
382   my $index = shift;
383   return 0 if ! defined $self->{ARRAY}->[$index] ||
384               $self->{ARRAY}->[$index] eq ' ' x $self->{ELEMSIZE};
385   return 1;
386 }
387
388=item DELETE this, key
389X<DELETE>
390
391Delete the element at index I<key> from the tied array I<this>.
392
393In our example, a deleted item is C<$self-E<gt>{ELEMSIZE}> spaces:
394
395    sub DELETE {
396      my $self  = shift;
397      my $index = shift;
398      return $self->STORE( $index, '' );
399    }
400
401=item CLEAR this
402X<CLEAR>
403
404Clear (remove, delete, ...) all values from the tied array associated with
405object I<this>.  For example:
406
407    sub CLEAR {
408      my $self = shift;
409      return $self->{ARRAY} = [];
410    }
411
412=item PUSH this, LIST
413X<PUSH>
414
415Append elements of I<LIST> to the array.  For example:
416
417    sub PUSH {
418      my $self = shift;
419      my @list = @_;
420      my $last = $self->FETCHSIZE();
421      $self->STORE( $last + $_, $list[$_] ) foreach 0 .. $#list;
422      return $self->FETCHSIZE();
423    }
424
425=item POP this
426X<POP>
427
428Remove last element of the array and return it.  For example:
429
430    sub POP {
431      my $self = shift;
432      return pop $self->{ARRAY}->@*;
433    }
434
435=item SHIFT this
436X<SHIFT>
437
438Remove the first element of the array (shifting other elements down)
439and return it.  For example:
440
441    sub SHIFT {
442      my $self = shift;
443      return shift $self->{ARRAY}->@*;
444    }
445
446=item UNSHIFT this, LIST
447X<UNSHIFT>
448
449Insert LIST elements at the beginning of the array, moving existing elements
450up to make room.  For example:
451
452    sub UNSHIFT {
453      my $self = shift;
454      my @list = @_;
455      my $size = scalar( @list );
456      # make room for our list
457      $self->{ARRAY}[ $size .. $self->{ARRAY}->$#* + $size ]->@*
458       = $self->{ARRAY}->@*
459      $self->STORE( $_, $list[$_] ) foreach 0 .. $#list;
460    }
461
462=item SPLICE this, offset, length, LIST
463X<SPLICE>
464
465Perform the equivalent of C<splice> on the array.
466
467I<offset> is optional and defaults to zero, negative values count back
468from the end of the array.
469
470I<length> is optional and defaults to rest of the array.
471
472I<LIST> may be empty.
473
474Returns a list of the original I<length> elements at I<offset>.
475
476In our example, we'll use a little shortcut if there is a I<LIST>:
477
478    sub SPLICE {
479      my $self   = shift;
480      my $offset = shift || 0;
481      my $length = shift || $self->FETCHSIZE() - $offset;
482      my @list   = ();
483      if ( @_ ) {
484        tie @list, __PACKAGE__, $self->{ELEMSIZE};
485        @list   = @_;
486      }
487      return splice $self->{ARRAY}->@*, $offset, $length, @list;
488    }
489
490=item UNTIE this
491X<UNTIE>
492
493Will be called when C<untie> happens. (See L</The C<untie> Gotcha> below.)
494
495=item DESTROY this
496X<DESTROY>
497
498This method will be triggered when the tied variable needs to be destructed.
499As with the scalar tie class, this is almost never needed in a
500language that does its own garbage collection, so this time we'll
501just leave it out.
502
503=back
504
505=head2 Tying Hashes
506X<hash, tying>
507
508Hashes were the first Perl data type to be tied (see dbmopen()).  A class
509implementing a tied hash should define the following methods: TIEHASH is
510the constructor.  FETCH and STORE access the key and value pairs.  EXISTS
511reports whether a key is present in the hash, and DELETE deletes one.
512CLEAR empties the hash by deleting all the key and value pairs.  FIRSTKEY
513and NEXTKEY implement the keys() and each() functions to iterate over all
514the keys. SCALAR is triggered when the tied hash is evaluated in scalar
515context, and in 5.28 onwards, by C<keys> in boolean context. UNTIE is
516called when C<untie> happens, and DESTROY is called when the tied variable
517is garbage collected.
518
519If this seems like a lot, then feel free to inherit from merely the
520standard Tie::StdHash module for most of your methods, redefining only the
521interesting ones.  See L<Tie::Hash> for details.
522
523Remember that Perl distinguishes between a key not existing in the hash,
524and the key existing in the hash but having a corresponding value of
525C<undef>.  The two possibilities can be tested with the C<exists()> and
526C<defined()> functions.
527
528Here's an example of a somewhat interesting tied hash class:  it gives you
529a hash representing a particular user's dot files.  You index into the hash
530with the name of the file (minus the dot) and you get back that dot file's
531contents.  For example:
532
533    use DotFiles;
534    tie %dot, 'DotFiles';
535    if ( $dot{profile} =~ /MANPATH/ ||
536         $dot{login}   =~ /MANPATH/ ||
537         $dot{cshrc}   =~ /MANPATH/    )
538    {
539	print "you seem to set your MANPATH\n";
540    }
541
542Or here's another sample of using our tied class:
543
544    tie %him, 'DotFiles', 'daemon';
545    foreach $f ( keys %him ) {
546	printf "daemon dot file %s is size %d\n",
547	    $f, length $him{$f};
548    }
549
550In our tied hash DotFiles example, we use a regular
551hash for the object containing several important
552fields, of which only the C<{LIST}> field will be what the
553user thinks of as the real hash.
554
555=over 5
556
557=item USER
558
559whose dot files this object represents
560
561=item HOME
562
563where those dot files live
564
565=item CLOBBER
566
567whether we should try to change or remove those dot files
568
569=item LIST
570
571the hash of dot file names and content mappings
572
573=back
574
575Here's the start of F<Dotfiles.pm>:
576
577    package DotFiles;
578    use Carp;
579    sub whowasi { (caller(1))[3] . '()' }
580    my $DEBUG = 0;
581    sub debug { $DEBUG = @_ ? shift : 1 }
582
583For our example, we want to be able to emit debugging info to help in tracing
584during development.  We keep also one convenience function around
585internally to help print out warnings; whowasi() returns the function name
586that calls it.
587
588Here are the methods for the DotFiles tied hash.
589
590=over 4
591
592=item TIEHASH classname, LIST
593X<TIEHASH>
594
595This is the constructor for the class.  That means it is expected to
596return a blessed reference through which the new object (probably but not
597necessarily an anonymous hash) will be accessed.
598
599Here's the constructor:
600
601    sub TIEHASH {
602	my $class = shift;
603	my $user = shift || $>;
604	my $dotdir = shift || '';
605	croak "usage: @{[&whowasi]} [USER [DOTDIR]]" if @_;
606	$user = getpwuid($user) if $user =~ /^\d+$/;
607	my $dir = (getpwnam($user))[7]
608		|| croak "@{[&whowasi]}: no user $user";
609	$dir .= "/$dotdir" if $dotdir;
610
611	my $node = {
612	    USER    => $user,
613	    HOME    => $dir,
614	    LIST    => {},
615	    CLOBBER => 0,
616	};
617
618	opendir(DIR, $dir)
619		|| croak "@{[&whowasi]}: can't opendir $dir: $!";
620	foreach $dot ( grep /^\./ && -f "$dir/$_", readdir(DIR)) {
621	    $dot =~ s/^\.//;
622	    $node->{LIST}{$dot} = undef;
623	}
624	closedir DIR;
625	return bless $node, $class;
626    }
627
628It's probably worth mentioning that if you're going to filetest the
629return values out of a readdir, you'd better prepend the directory
630in question.  Otherwise, because we didn't chdir() there, it would
631have been testing the wrong file.
632
633=item FETCH this, key
634X<FETCH>
635
636This method will be triggered every time an element in the tied hash is
637accessed (read).  It takes one argument beyond its self reference: the key
638whose value we're trying to fetch.
639
640Here's the fetch for our DotFiles example.
641
642    sub FETCH {
643	carp &whowasi if $DEBUG;
644	my $self = shift;
645	my $dot = shift;
646	my $dir = $self->{HOME};
647	my $file = "$dir/.$dot";
648
649	unless (exists $self->{LIST}->{$dot} || -f $file) {
650	    carp "@{[&whowasi]}: no $dot file" if $DEBUG;
651	    return undef;
652	}
653
654	if (defined $self->{LIST}->{$dot}) {
655	    return $self->{LIST}->{$dot};
656	} else {
657	    return $self->{LIST}->{$dot} = `cat $dir/.$dot`;
658	}
659    }
660
661It was easy to write by having it call the Unix cat(1) command, but it
662would probably be more portable to open the file manually (and somewhat
663more efficient).  Of course, because dot files are a Unixy concept, we're
664not that concerned.
665
666=item STORE this, key, value
667X<STORE>
668
669This method will be triggered every time an element in the tied hash is set
670(written).  It takes two arguments beyond its self reference: the index at
671which we're trying to store something, and the value we're trying to put
672there.
673
674Here in our DotFiles example, we'll be careful not to let
675them try to overwrite the file unless they've called the clobber()
676method on the original object reference returned by tie().
677
678    sub STORE {
679	carp &whowasi if $DEBUG;
680	my $self = shift;
681	my $dot = shift;
682	my $value = shift;
683	my $file = $self->{HOME} . "/.$dot";
684	my $user = $self->{USER};
685
686	croak "@{[&whowasi]}: $file not clobberable"
687	    unless $self->{CLOBBER};
688
689	open(my $f, '>', $file) || croak "can't open $file: $!";
690	print $f $value;
691	close($f);
692    }
693
694If they wanted to clobber something, they might say:
695
696    $ob = tie %daemon_dots, 'daemon';
697    $ob->clobber(1);
698    $daemon_dots{signature} = "A true daemon\n";
699
700Another way to lay hands on a reference to the underlying object is to
701use the tied() function, so they might alternately have set clobber
702using:
703
704    tie %daemon_dots, 'daemon';
705    tied(%daemon_dots)->clobber(1);
706
707The clobber method is simply:
708
709    sub clobber {
710	my $self = shift;
711	$self->{CLOBBER} = @_ ? shift : 1;
712    }
713
714=item DELETE this, key
715X<DELETE>
716
717This method is triggered when we remove an element from the hash,
718typically by using the delete() function.  Again, we'll
719be careful to check whether they really want to clobber files.
720
721 sub DELETE   {
722     carp &whowasi if $DEBUG;
723
724     my $self = shift;
725     my $dot = shift;
726     my $file = $self->{HOME} . "/.$dot";
727     croak "@{[&whowasi]}: won't remove file $file"
728         unless $self->{CLOBBER};
729     delete $self->{LIST}->{$dot};
730     my $success = unlink($file);
731     carp "@{[&whowasi]}: can't unlink $file: $!" unless $success;
732     $success;
733 }
734
735The value returned by DELETE becomes the return value of the call
736to delete().  If you want to emulate the normal behavior of delete(),
737you should return whatever FETCH would have returned for this key.
738In this example, we have chosen instead to return a value which tells
739the caller whether the file was successfully deleted.
740
741=item CLEAR this
742X<CLEAR>
743
744This method is triggered when the whole hash is to be cleared, usually by
745assigning the empty list to it.
746
747In our example, that would remove all the user's dot files!  It's such a
748dangerous thing that they'll have to set CLOBBER to something higher than
7491 to make it happen.
750
751 sub CLEAR    {
752     carp &whowasi if $DEBUG;
753     my $self = shift;
754     croak "@{[&whowasi]}: won't remove all dot files for $self->{USER}"
755         unless $self->{CLOBBER} > 1;
756     my $dot;
757     foreach $dot ( keys $self->{LIST}->%* ) {
758         $self->DELETE($dot);
759     }
760 }
761
762=item EXISTS this, key
763X<EXISTS>
764
765This method is triggered when the user uses the exists() function
766on a particular hash.  In our example, we'll look at the C<{LIST}>
767hash element for this:
768
769    sub EXISTS   {
770	carp &whowasi if $DEBUG;
771	my $self = shift;
772	my $dot = shift;
773	return exists $self->{LIST}->{$dot};
774    }
775
776=item FIRSTKEY this
777X<FIRSTKEY>
778
779This method will be triggered when the user is going
780to iterate through the hash, such as via a keys(), values(), or each() call.
781
782    sub FIRSTKEY {
783	carp &whowasi if $DEBUG;
784	my $self = shift;
785	my $x = keys $self->{LIST}->%*;  # reset each() iterator
786	each $self->{LIST}->%*
787    }
788
789FIRSTKEY is always called in scalar context and it should just
790return the first key.  values(), and each() in list context,
791will call FETCH for the returned keys.
792
793=item NEXTKEY this, lastkey
794X<NEXTKEY>
795
796This method gets triggered during a keys(), values(), or each() iteration.  It has a
797second argument which is the last key that had been accessed.  This is
798useful if you're caring about ordering or calling the iterator from more
799than one sequence, or not really storing things in a hash anywhere.
800
801NEXTKEY is always called in scalar context and it should just
802return the next key.  values(), and each() in list context,
803will call FETCH for the returned keys.
804
805For our example, we're using a real hash so we'll do just the simple
806thing, but we'll have to go through the LIST field indirectly.
807
808    sub NEXTKEY  {
809	carp &whowasi if $DEBUG;
810	my $self = shift;
811	return each $self->{LIST}->%*
812    }
813
814If the object underlying your tied hash isn't a real hash and you don't have
815C<each> available, then you should return C<undef> or the empty list once you've
816reached the end of your list of keys. See L<C<each's own documentation>|perlfunc/each>
817for more details.
818
819=item SCALAR this
820X<SCALAR>
821
822This is called when the hash is evaluated in scalar context, and in 5.28
823onwards, by C<keys> in boolean context. In order to mimic the behaviour of
824untied hashes, this method must return a value which when used as boolean,
825indicates whether the tied hash is considered empty. If this method does
826not exist, perl will make some educated guesses and return true when
827the hash is inside an iteration. If this isn't the case, FIRSTKEY is
828called, and the result will be a false value if FIRSTKEY returns the empty
829list, true otherwise.
830
831However, you should B<not> blindly rely on perl always doing the right
832thing. Particularly, perl will mistakenly return true when you clear the
833hash by repeatedly calling DELETE until it is empty. You are therefore
834advised to supply your own SCALAR method when you want to be absolutely
835sure that your hash behaves nicely in scalar context.
836
837In our example we can just call C<scalar> on the underlying hash
838referenced by C<$self-E<gt>{LIST}>:
839
840    sub SCALAR {
841	carp &whowasi if $DEBUG;
842	my $self = shift;
843	return scalar $self->{LIST}->%*
844    }
845
846NOTE: In perl 5.25 the behavior of scalar %hash on an untied hash changed
847to return the count of keys. Prior to this it returned a string containing
848information about the bucket setup of the hash. See
849L<Hash::Util/bucket_ratio> for a backwards compatibility path.
850
851=item UNTIE this
852X<UNTIE>
853
854This is called when C<untie> occurs.  See L</The C<untie> Gotcha> below.
855
856=item DESTROY this
857X<DESTROY>
858
859This method is triggered when a tied hash is about to go out of
860scope.  You don't really need it unless you're trying to add debugging
861or have auxiliary state to clean up.  Here's a very simple function:
862
863    sub DESTROY  {
864	carp &whowasi if $DEBUG;
865    }
866
867=back
868
869Note that functions such as keys() and values() may return huge lists
870when used on large objects, like DBM files.  You may prefer to use the
871each() function to iterate over such.  Example:
872
873    # print out history file offsets
874    use NDBM_File;
875    tie(%HIST, 'NDBM_File', '/usr/lib/news/history', 1, 0);
876    while (($key,$val) = each %HIST) {
877        print $key, ' = ', unpack('L',$val), "\n";
878    }
879    untie(%HIST);
880
881=head2 Tying FileHandles
882X<filehandle, tying>
883
884This is partially implemented now.
885
886A class implementing a tied filehandle should define the following
887methods: TIEHANDLE, at least one of PRINT, PRINTF, WRITE, READLINE, GETC,
888READ, and possibly CLOSE, UNTIE and DESTROY.  The class can also provide: BINMODE,
889OPEN, EOF, FILENO, SEEK, TELL - if the corresponding perl operators are
890used on the handle.
891
892When STDERR is tied, its PRINT method will be called to issue warnings
893and error messages.  This feature is temporarily disabled during the call,
894which means you can use C<warn()> inside PRINT without starting a recursive
895loop.  And just like C<__WARN__> and C<__DIE__> handlers, STDERR's PRINT
896method may be called to report parser errors, so the caveats mentioned under
897L<perlvar/%SIG> apply.
898
899All of this is especially useful when perl is embedded in some other
900program, where output to STDOUT and STDERR may have to be redirected
901in some special way.  See nvi and the Apache module for examples.
902
903When tying a handle, the first argument to C<tie> should begin with an
904asterisk.  So, if you are tying STDOUT, use C<*STDOUT>.  If you have
905assigned it to a scalar variable, say C<$handle>, use C<*$handle>.
906C<tie $handle> ties the scalar variable C<$handle>, not the handle inside
907it.
908
909In our example we're going to create a shouting handle.
910
911    package Shout;
912
913=over 4
914
915=item TIEHANDLE classname, LIST
916X<TIEHANDLE>
917
918This is the constructor for the class.  That means it is expected to
919return a blessed reference of some sort. The reference can be used to
920hold some internal information.
921
922    sub TIEHANDLE { print "<shout>\n"; my $i; bless \$i, shift }
923
924=item WRITE this, LIST
925X<WRITE>
926
927This method will be called when the handle is written to via the
928C<syswrite> function.
929
930 sub WRITE {
931     $r = shift;
932     my($buf,$len,$offset) = @_;
933     print "WRITE called, \$buf=$buf, \$len=$len, \$offset=$offset";
934 }
935
936=item PRINT this, LIST
937X<PRINT>
938
939This method will be triggered every time the tied handle is printed to
940with the C<print()> or C<say()> functions.  Beyond its self reference
941it also expects the list that was passed to the print function.
942
943  sub PRINT { $r = shift; $$r++; print join($,,map(uc($_),@_)),$\ }
944
945C<say()> acts just like C<print()> except $\ will be localized to C<\n> so
946you need do nothing special to handle C<say()> in C<PRINT()>.
947
948=item PRINTF this, LIST
949X<PRINTF>
950
951This method will be triggered every time the tied handle is printed to
952with the C<printf()> function.
953Beyond its self reference it also expects the format and list that was
954passed to the printf function.
955
956    sub PRINTF {
957        shift;
958        my $fmt = shift;
959        print sprintf($fmt, @_);
960    }
961
962=item READ this, LIST
963X<READ>
964
965This method will be called when the handle is read from via the C<read>
966or C<sysread> functions.
967
968 sub READ {
969   my $self = shift;
970   my $bufref = \$_[0];
971   my(undef,$len,$offset) = @_;
972   print "READ called, \$buf=$bufref, \$len=$len, \$offset=$offset";
973   # add to $$bufref, set $len to number of characters read
974   $len;
975 }
976
977=item READLINE this
978X<READLINE>
979
980This method is called when the handle is read via C<E<lt>HANDLEE<gt>>
981or C<readline HANDLE>.
982
983As per L<C<readline>|perlfunc/readline>, in scalar context it should return
984the next line, or C<undef> for no more data.  In list context it should
985return all remaining lines, or an empty list for no more data.  The strings
986returned should include the input record separator C<$/> (see L<perlvar>),
987unless it is C<undef> (which means "slurp" mode).
988
989    sub READLINE {
990      my $r = shift;
991      if (wantarray) {
992        return ("all remaining\n",
993                "lines up\n",
994                "to eof\n");
995      } else {
996        return "READLINE called " . ++$$r . " times\n";
997      }
998    }
999
1000=item GETC this
1001X<GETC>
1002
1003This method will be called when the C<getc> function is called.
1004
1005    sub GETC { print "Don't GETC, Get Perl"; return "a"; }
1006
1007=item EOF this
1008X<EOF>
1009
1010This method will be called when the C<eof> function is called.
1011
1012Starting with Perl 5.12, an additional integer parameter will be passed.  It
1013will be zero if C<eof> is called without parameter; C<1> if C<eof> is given
1014a filehandle as a parameter, e.g. C<eof(FH)>; and C<2> in the very special
1015case that the tied filehandle is C<ARGV> and C<eof> is called with an empty
1016parameter list, e.g. C<eof()>.
1017
1018    sub EOF { not length $stringbuf }
1019
1020=item CLOSE this
1021X<CLOSE>
1022
1023This method will be called when the handle is closed via the C<close>
1024function.
1025
1026    sub CLOSE { print "CLOSE called.\n" }
1027
1028=item UNTIE this
1029X<UNTIE>
1030
1031As with the other types of ties, this method will be called when C<untie> happens.
1032It may be appropriate to "auto CLOSE" when this occurs.  See
1033L</The C<untie> Gotcha> below.
1034
1035=item DESTROY this
1036X<DESTROY>
1037
1038As with the other types of ties, this method will be called when the
1039tied handle is about to be destroyed. This is useful for debugging and
1040possibly cleaning up.
1041
1042    sub DESTROY { print "</shout>\n" }
1043
1044=back
1045
1046Here's how to use our little example:
1047
1048    tie(*FOO,'Shout');
1049    print FOO "hello\n";
1050    $x = 4; $y = 6;
1051    print FOO $x, " plus ", $y, " equals ", $x + $y, "\n";
1052    print <FOO>;
1053
1054=head2 UNTIE this
1055X<UNTIE>
1056
1057You can define for all tie types an UNTIE method that will be called
1058at untie().  See L</The C<untie> Gotcha> below.
1059
1060=head2 The C<untie> Gotcha
1061X<untie>
1062
1063If you intend making use of the object returned from either tie() or
1064tied(), and if the tie's target class defines a destructor, there is a
1065subtle gotcha you I<must> guard against.
1066
1067As setup, consider this (admittedly rather contrived) example of a
1068tie; all it does is use a file to keep a log of the values assigned to
1069a scalar.
1070
1071    package Remember;
1072
1073    use v5.36;
1074    use IO::File;
1075
1076    sub TIESCALAR {
1077        my $class = shift;
1078        my $filename = shift;
1079        my $handle = IO::File->new( "> $filename" )
1080                         or die "Cannot open $filename: $!\n";
1081
1082        print $handle "The Start\n";
1083        bless {FH => $handle, Value => 0}, $class;
1084    }
1085
1086    sub FETCH {
1087        my $self = shift;
1088        return $self->{Value};
1089    }
1090
1091    sub STORE {
1092        my $self = shift;
1093        my $value = shift;
1094        my $handle = $self->{FH};
1095        print $handle "$value\n";
1096        $self->{Value} = $value;
1097    }
1098
1099    sub DESTROY {
1100        my $self = shift;
1101        my $handle = $self->{FH};
1102        print $handle "The End\n";
1103        close $handle;
1104    }
1105
1106    1;
1107
1108Here is an example that makes use of this tie:
1109
1110    use strict;
1111    use Remember;
1112
1113    my $fred;
1114    tie $fred, 'Remember', 'myfile.txt';
1115    $fred = 1;
1116    $fred = 4;
1117    $fred = 5;
1118    untie $fred;
1119    system "cat myfile.txt";
1120
1121This is the output when it is executed:
1122
1123    The Start
1124    1
1125    4
1126    5
1127    The End
1128
1129So far so good.  Those of you who have been paying attention will have
1130spotted that the tied object hasn't been used so far.  So lets add an
1131extra method to the Remember class to allow comments to be included in
1132the file; say, something like this:
1133
1134    sub comment {
1135        my $self = shift;
1136        my $text = shift;
1137        my $handle = $self->{FH};
1138        print $handle $text, "\n";
1139    }
1140
1141And here is the previous example modified to use the C<comment> method
1142(which requires the tied object):
1143
1144    use strict;
1145    use Remember;
1146
1147    my ($fred, $x);
1148    $x = tie $fred, 'Remember', 'myfile.txt';
1149    $fred = 1;
1150    $fred = 4;
1151    comment $x "changing...";
1152    $fred = 5;
1153    untie $fred;
1154    system "cat myfile.txt";
1155
1156When this code is executed there is no output.  Here's why:
1157
1158When a variable is tied, it is associated with the object which is the
1159return value of the TIESCALAR, TIEARRAY, or TIEHASH function.  This
1160object normally has only one reference, namely, the implicit reference
1161from the tied variable.  When untie() is called, that reference is
1162destroyed.  Then, as in the first example above, the object's
1163destructor (DESTROY) is called, which is normal for objects that have
1164no more valid references; and thus the file is closed.
1165
1166In the second example, however, we have stored another reference to
1167the tied object in $x.  That means that when untie() gets called
1168there will still be a valid reference to the object in existence, so
1169the destructor is not called at that time, and thus the file is not
1170closed.  The reason there is no output is because the file buffers
1171have not been flushed to disk.
1172
1173Now that you know what the problem is, what can you do to avoid it?
1174Prior to the introduction of the optional UNTIE method the only way
1175was the good old C<-w> flag. Which will spot any instances where you call
1176untie() and there are still valid references to the tied object.  If
1177the second script above this near the top C<use warnings 'untie'>
1178or was run with the C<-w> flag, Perl prints this
1179warning message:
1180
1181    untie attempted while 1 inner references still exist
1182
1183To get the script to work properly and silence the warning make sure
1184there are no valid references to the tied object I<before> untie() is
1185called:
1186
1187    undef $x;
1188    untie $fred;
1189
1190Now that UNTIE exists the class designer can decide which parts of the
1191class functionality are really associated with C<untie> and which with
1192the object being destroyed. What makes sense for a given class depends
1193on whether the inner references are being kept so that non-tie-related
1194methods can be called on the object. But in most cases it probably makes
1195sense to move the functionality that would have been in DESTROY to the UNTIE
1196method.
1197
1198If the UNTIE method exists then the warning above does not occur. Instead the
1199UNTIE method is passed the count of "extra" references and can issue its own
1200warning if appropriate. e.g. to replicate the no UNTIE case this method can
1201be used:
1202
1203 sub UNTIE
1204 {
1205  my ($obj,$count) = @_;
1206  carp "untie attempted while $count inner references still exist"
1207                                                              if $count;
1208 }
1209
1210=head1 SEE ALSO
1211
1212See L<DB_File> or L<Config> for some interesting tie() implementations.
1213A good starting point for many tie() implementations is with one of the
1214modules L<Tie::Scalar>, L<Tie::Array>, L<Tie::Hash>, or L<Tie::Handle>.
1215
1216=head1 BUGS
1217
1218The normal return provided by C<scalar(%hash)> is not
1219available.  What this means is that using %tied_hash in boolean
1220context doesn't work right (currently this always tests false,
1221regardless of whether the hash is empty or hash elements).
1222[ This paragraph needs review in light of changes in 5.25 ]
1223
1224Localizing tied arrays or hashes does not work.  After exiting the
1225scope the arrays or the hashes are not restored.
1226
1227Counting the number of entries in a hash via C<scalar(keys(%hash))>
1228or C<scalar(values(%hash)>) is inefficient since it needs to iterate
1229through all the entries with FIRSTKEY/NEXTKEY.
1230
1231Tied hash/array slices cause multiple FETCH/STORE pairs, there are no
1232tie methods for slice operations.
1233
1234You cannot easily tie a multilevel data structure (such as a hash of
1235hashes) to a dbm file.  The first problem is that all but GDBM and
1236Berkeley DB have size limitations, but beyond that, you also have problems
1237with how references are to be represented on disk.  One
1238module that does attempt to address this need is DBM::Deep.  Check your
1239nearest CPAN site as described in L<perlmodlib> for source code.  Note
1240that despite its name, DBM::Deep does not use dbm.  Another earlier attempt
1241at solving the problem is MLDBM, which is also available on the CPAN, but
1242which has some fairly serious limitations.
1243
1244Tied filehandles are still incomplete.  sysopen(), truncate(),
1245flock(), fcntl(), stat() and -X can't currently be trapped.
1246
1247=head1 AUTHOR
1248
1249Tom Christiansen
1250
1251TIEHANDLE by Sven Verdoolaege <F<skimo@dns.ufsia.ac.be>> and Doug MacEachern <F<dougm@osf.org>>
1252
1253UNTIE by Nick Ing-Simmons <F<nick@ing-simmons.net>>
1254
1255SCALAR by Tassilo von Parseval <F<tassilo.von.parseval@rwth-aachen.de>>
1256
1257Tying Arrays by Casey West <F<casey@geeknest.com>>
1258