Mastering Lora The Ultimate Guide To Efficient Llm Fine Tuning

Leo Migdal
-
mastering lora the ultimate guide to efficient llm fine tuning

This technical report thoroughly examines the process of fine-tuning Large Language Models (LLMs), integrating theoretical insights and practical applications. It begins by tracing the historical development of LLMs, emphasising their evolution from traditional Natural Language Processing (NLP) models and their pivotal role in modern AI systems. The analysis differentiates between various fine-tuning methodologies, including supervised, unsupervised, and instruction-based approaches, underscoring their respective implications for specific tasks. A structured seven-stage pipeline for LLM fine-tuning is introduced, covering the complete lifecycle from data preparation to model deployment. Key considerations include data collection strategies, handling of imbalanced datasets, model initialisation, and optimisation techniques, with a particular focus on hyperparameter tuning. The report also highlights parameter-efficient fine-tuning methods such as Low-Rank Adaptation (LoRA) and Half Fine-Tuning, which balance resource constraints with optimal model performance.

The exploration extends to advanced fine-tuning techniques and configurations like memory fine-tuning, Mixture of Experts (MoE) and Mixture of Agents (MoA), demonstrating how these methods harness specialised networks and multi-agent collaboration for improved outcomes. Proximal Policy Optimisation (PPO) and Direct Preference Optimisation (DPO) are discussed as innovative approaches to aligning models with human preferences, while the benefits of pruning and routing optimisations are examined for enhancing efficiency. In the latter sections, the report delves into validation frameworks, post-deployment monitoring, and optimisation techniques for inference. It also addresses the deployment of LLMs on distributed and cloud-based platforms. Additionally, cutting-edge topics such as multimodal LLMs and fine-tuning for audio and speech processing are covered, alongside emerging challenges related to scalability, privacy, and accountability. This report aims to serve as a comprehensive guide for researchers and practitioners, offering actionable insights into fine-tuning LLMs while navigating the challenges and opportunities inherent in this rapidly evolving field.

For years, the idea of truly customizing a Large Language Model felt like a privilege reserved for tech giants with bottomless budgets. The barrier to entry wasn’t just knowledge; it was the astronomical cost of computing power needed to retrain billions of parameters. That’s where a technique called LoRA (Low-Rank Adaptation) comes in. It just made fine-tuning accessible to everyone. In this article, I’ll take you through a step-by-step guide to fine-tuning LLMs with LoRA. Let’s get straight to the point.

An LLM is essentially a massive collection of numbers, called weights or parameters. A model like Llama 3 8B has 8 billion of them. When we “fine-tune” a model, we’re adjusting all of these numbers so the model gets better at a specific task, like writing in a particular brand’s voice. The traditional approach, full fine-tuning, means updating every single one of those 8 billion parameters. This is why, for a long time, customizing LLMs was out of reach for most of us. So, how do we get around this?

We use a smarter approach from a family of techniques called Parameter-Efficient Fine-Tuning (PEFT). The star of this family is LoRA (Low-Rank Adaptation). Here’s how LoRA works under the hood, in simple terms: Fine tuning updates all the parameters of a pre-trained model to adapt it for a specific task, offering high accuracy but requiring significant computational resources and memory. In contrast, LoRA (Low-Rank Adaptation) is a parameter-efficient technique that introduces small trainable matrices into certain layers, allowing most of the original model parameters to remain unchanged. This approach drastically reduces memory and compute requirements, making LoRA much faster and more efficient than full finetuning, especially for large language models, while still achieving comparable performance on many tasks.

Fine-tuning involves taking a pre-trained language model (which has already learned a vast amount of general knowledge and language patterns from a diverse dataset) and further training it on a smaller, task-specific, or domain-specific... In its original form, fine-tuning involves updating all, or a significant portion, of a pre-trained model’s parameters.For models with hundreds of millions or even billions of parameters, this is a computationally intensive and resource-demanding... It requires substantial GPU power, memory, and time, making it less practical for frequent updates or for users with limited hardware. The output is a new, specialized version of the entire model. The below image shows a transformer block architecture where adapters are inserted after the feed-forward network and before layer normalization. In LoRA, these adapters are implemented as low-rank matrices.

During fine-tuning, only these adapter parameters are updated, while the core model weights (multi-head attention, feed-forward network, etc.) stay fixed. Below are the three scenarios compared where each scenario reduces the number of trainable parameters and resource requirements, with LoRA and QLoRA being the most efficient for fine-tuning large models. The world of Large Language Models (LLMs) is rapidly evolving, and with their immense power comes an equally immense appetite for computational resources. Fine-tuning these behemoths to adapt them to specific tasks or domains is crucial for real-world applications. However, traditional fine-tuning methods often demand an impractical amount of hardware. This is where Parameter-Efficient Fine-Tuning (PEFT) techniques, specifically LoRA (Low-Rank Adaptation) and QLoRA (Quantized Low-Rank Adaptation), come into play, offering a revolutionary approach to efficient LLM customisation.

Before diving into LoRA, let's understand the conventional approach: full fine-tuning. This method involves updating all the parameters within a pre-trained LLM. While effective, it requires significant computational resources, including numerous heavy-duty GPUs, which are typically beyond the reach of a normal consumer or developer. Imagine a large matrix 'W' representing all the weights of a deep neural network within an LLM – full fine-tuning means modifying every single value in this colossal matrix. Thanks for reading Silicon & Soul! Subscribe for free to receive new posts and support my work.

To address this, PEFT emerged. Instead of updating all the weights in a large matrix, PEFT focuses on updating only a small subset of the weights, making the process computationally efficient. Among PEFT techniques, LoRA stands out as one of the most important and efficient. To truly grasp LoRA, we first need to understand two fundamental mathematical concepts: Fine-tuning large language models (LLMs) has become an essential technique for adapting pre-trained models to specific tasks. However, full fine-tuning can be computationally expensive and resource-intensive.

Low-Rank Adaptation (LoRA) is a technique that significantly reduces the computational overhead while maintaining strong performance. In this article, we will explore fine-tuning LLM using LoRA, its benefits, implementation, and best practices. Whether you’re a researcher, engineer, or AI enthusiast, this guide will help you understand how to optimize LLMs efficiently. LoRA (Low-Rank Adaptation) is a fine-tuning technique that modifies only a small subset of a pre-trained model’s weights, thereby reducing the number of trainable parameters. Instead of updating all model weights, LoRA introduces trainable low-rank matrices into the transformer layers, which are then adjusted during fine-tuning. LoRA operates by freezing the pre-trained model weights and injecting trainable rank decomposition matrices into transformer layers.

The core idea is to decompose weight updates into low-rank matrices, thereby reducing the total number of parameters that need to be updated. This approach ensures that the pre-trained model retains its general knowledge while making task-specific adaptations more efficient. Traditional fine-tuning updates all parameters of a pre-trained model, leading to high GPU memory consumption and longer training times. LoRA, on the other hand, introduces only a small number of additional trainable parameters, significantly lowering the memory footprint. Since these low-rank matrices are significantly smaller than the full model weights, the fine-tuning process becomes much more efficient while achieving comparable results. ������$��v,�9��#��M�v��h#����{�Z.B�v�_�D Gkg̖� ��������g�*���L��� ����T�S,���Z7��Y�X�M�������*`�L< w�����.�������3K`D������{I��6�3�ߣ��"�"���:PX-������K�:��PC��~ �7`����|O\9���E��DXJ��A���*�x�@���<Ц ڎ��ah��zD%a�Oٵ�Ut�����f��9��x�X�ʈEZ�gGT�ϴ[�َ]CS��k����"ec`�X���M��%� �^�m��7-KD����R���')զ@��3HtP?�ņm�� � �ؽ\�HS}�y4�A��æ��;�e 艉0�x{KR�1{0(�5�F)�m��'�4�����aT$?�PDw0EӇ��"!��u�+��� �� ���''y��*�|�xkW�i��i��Jn�4k�q��ѣ�1:56ҡ�4���;Kf�(E>�rz��@8i1Ot�@4RNDi2`�mɬw�����=Ag[J���~&��ދ`|�ԮAn���)��������jJK�o�QF��;[Q�uYe���U�E�A;�PL�1D� �m`��(�=H�r����Q�W�^��� ̯^˞���C�����>Y��cj�mۤ�:U*�gЖJB<�VD�����w�-��e 2�; {�ێ{���?q�'��ކlv���|�B2� ��y� �yub7���Ҷ�Ҩ-��p :�F?�����F=���f�`�R�WǐJ�k�`�S'M�O���5\�m�j�Uv'��T�ԼCx�v��y�%��V/ADa!b�d�����x�H�'��������J�9H=k�OK!@��� �]�J��t��?�$�g�b_�+_��U��H"o8,@ ��a�Z'3lk�#e�2�}3�B7�4��4���R�zv� \���T���R1; B%������r\���4�~<�m� ��7������{�w `��D��et� ��D�% [��������I�ntݮ��o]W�3�l��h�@d*�S_��Q�l��2غ����n�r'ݪk��׸��{=bZ���a���`!�M�Z$gˡR]�"�<;��� P�k5�� ;�ћ4 �s#�3��y��r� �M:��V`��8mR����<{��cr ��V(p�*�*�� y*�yX=zf�ϖ4rV�Q�/7�$�q��Z����[T��Re�ו�...

W�@�si��:�T8n�.V�ԒH��z�q��56�Qo��Q1Ǎ��][��PM��� �{~���՟�d�Sp�fZ��?!�v:�9d6"D��]F�V���u�0{�],м=~�<��7os ���A�'�>���O���A -' �jO9��� [�+�Ot�Z�t��d�\��Q�6q�u��G˷��>������ y��,�t���o^�4�Oe!���=��9EѶ��]�h3�� No�*���2M�n�'LU������qj�i���r�� ӓ�s�����[���q���lZ����?��$����1���6K�/���=>�͘SYَE��$H�E'O' �/l�� �ye�j<"��� ĝ�Ìz/Չ��?�E���A V��,�l%�i�i<>Ga��ds}e�&A��������0}��'nZ�+��7kX௷M�Iv��������RgZ�%\�1���N�F�! L�(��o�O������/� �LB���n?{h�.{t>�������@Y6�%��!�G��*�A�n6o�eC^⠓l@ n[bvJ%n� ���[��qŘ;j ���w�9\ ��$�s�a)H�H�tN� �ˋ�\o�P_@���"O��A�p!� Y}l����ߚ�,� �q�9l�3D�@腕�"�vPI/+ B��z#/��� A�x�{2 ��J��|&+����]���A�L� v���@$��x)���M�#�fG�:)۽_��� �b�Z����c���I��@0�NN��Nw,��2�'��1�z�͉3"{1Fp�i@fEk��c�5������z��;є��w����߶���iN#ꅈ�+��������\|�����O�J�-Q�̓����[ •Lz�"�?�fH����{�T�� ����w�#+��*\��5�\�*� "�;��;�G创�;Z+Q�uv���0A֡D���K�m����0D^PQrA���Υ��6 N�� B�~T�t0q�Qϣm:t7�`�� @zl"Dq4�$F�Rt���:������U��@K�k3fm�o�j/�w��c�ʴ#2� }�s�յrNP�=�쫢���9�t���<Gr'���᪐.�CM��w�ǝ�Zqfc��I�;�A΁2��*�R ���dU�Z�Z�kv�Ҹ�ԍ�o��D"!ځE�P�I��(�=�qϭE/c�ʡ�����{���vBAɔ�T�}�h>}2蕟�Y+�Yr>q�!� �r���� � �/���g<'g׶���i0R@�,@xb� ;�%f"�Z�4��S1��"�� ݴ Bj: �/�4�' &�H5�y�)7��q,�sl�=o��}0�̓�u�Hޝ��Y��H`^�7�>��l�7�B'D�į �+o�|�V�!�!�Q8H��ADj���븸P���#]�|Q/O�o���v��/�Iyt��p���!~䀔�����))n������^�N��In粛�.ܲ�y���g��P�<��ەo��t�Oܡ3�!�g4�p�sG��pz˭�:�m2^����0�%)�]��P�1�~��z�!����&)�r4KP�t8���M2�5�k��{�!��ђ[�2��w) �B�����~}���J�f�\ _vɢ{���i!XD �V���e">�8C����Rc���X-o�p�w... ����.�az�b=��P�������n!������Q �/_T�4�tY -�c��s �`D5���8*�@��hh��a\g�n��l�]j(��;?�R�A$�3 i�:u㫦�N��0+j�Åj-j֪S�+H-�7o��u�f��7���-���Iݿiҷo�^k������L��7���c�z�c��W��2����,�)���/�'�����4��S4��Y��B��m�&��cbÁ�c�\���������Œ��ܹ?@�� '@������<�Q/L���iP �����ă�>_;�Lc��X(��6�Ne;=׬� )v@��$at -A���8c�=��Q3��4�[w3����Ly4��/Dec\AO�3����s��ۓ�2�A��#��x�ё�F�z �3���M��;��U�����&��x�t �Da���h�b )��� �-+�DUL�] �� "��ym��j~� �m�k �,0�/�H��!��R�0�0�K�@�Z���t�:v/>���+\��i���]��+ 䐁P��ʛ���G�Ș���W�}�[���7�oK����,nTQl^1E7 ��;���1>��{d�8������1Ax}ca4+m��z��S�m!�Q��ح�!����U���� �5�Q�|����/ܗ��'-r� p}�+׾��*o5�[� ��5�o��1cb[�������T**Õ���H�NlgT�"-�Hn�9DrFY;��)&�{ ��bD.'y�<�� X:M�k ���KO�I�6��X�� ��CA���m�O�L� �&%��{=I���r���G}���*� T��0[܏��b�$�:j7�+ܨ�S���(|b�4�"�!�4GTT?��z�M����y:�I�"���B�mRB-.����-�a!�p��6�͝�#v�q�a�kԝM��}m�a�8OG"%�3S��N0?��<>w��zGP�s�� $ϻB/��8�;:3��:����iƆ&�Hk�٦��Y�co�f��dV!]��t @j�Ͼ�ԭ�@��Wr�� A��9�1+�8������#��Wv�)"��$�: ��ϯQ�8���a.��)�BS҇��r�rA�y&b�ۭ������.Qn�up'�T.�V��i��׽G��N��/w�Q�ļ�c�1�!Sv<\B��Dd�.�6����>խ��Fi�q�r&�]YF}y�!Ϝ> ˆ�>ɽ�k���;=Gof#ع��� �A�`B�... uu�M�h�2x���G�D��h��7//�-F3�<2g�A��V�r�� w���@u����0k�^}���SLx)���G�S�� I�� &3*���q�Z<�L�o^޶�Ѫ� �M�:,Hq�����U� ��Bq� /)�Ms�l�h�}�@�u#�Y�Ӱ��y�+kt��o$�E��v���{�|��p��J���!����_�:��[�<�>H ���4{[2�~��މF}9^zgy'��8�q�����S#XAz��˓;^i�AJ}��\��|��Ro����ݏ������@|��R�CTR��W�e�Z䐄�3�s���8�� ��K��]C�+D�0��2��i�o���,��Ar)�}&� ۙ�0E] A]��R@Q,���i�Nb|�����u�S1C�(!׍��B9���������P7�� _.q�aL��c6�����)�e������~���c�!e_���J�);������zxi���띦� �k��1�Jdg^��B�=�[ZJғ �����60��u������}� =��}}[�i��A���Q��x�/sH����Y���JZs�!�l�6�����/ɧbH�,���N�3&:�n�.2s�E#}܏��e�ɍ��}��6)�qr9<)goei�����r���Ǵ�N$�]�F��~��1��y~���y�1�\er Z�P) V����C�~Q��Q����t�oL�te!ze�fU�5���;*F5C� ��� B圦��;r�rE�SokQvL�?���쳬� �˺��h�֗���dD6 50P9��c��ɖC �M��iw�Uv0n +�8�>l�JK���?:���o���H��Rӄ�Ǩݨ����+��ۻ�߄��ق�v���UB(>�w�ϺZ��=4'�(�ݨIJ�*ΚV-�D�=������|[K��CU1CØ |mO�eZz��Nb��2 я4V_M���xjZ��ؾ�"�u�����q� ����с�]W��<�"w�`>�(Nl`=�.�d��6����N#��ը �3m�5�� / ~��0�?^kHG�+:�.+N)9 ��;E�]�@L�le�&�9�� ܉⺺Z_]:'�(��a�-q�e E� ����|����z�;q����d���Ԙ�pV��3�)c�콖M��w�"�:ar����;M�t�n\��J�i�*�QN{i��|�kߣ��k���Wjp�Ƹ@�k��R��%94�B]^�ohL�vGk<�\}�Y/u�h�J�T\�> *�W�������R��c�u�V2�B���L��<��|OK�m��Ӯ�4�+y�K<)x�Z... ��A�\Zcw#4���Pf��A1�� d҆�#�Үඕk� �r4 {#�`�� RD8{c���G*��}�� �Q��ߨl����%NMj��[�"|���Ir�M���* A�N�yk�F"#g(("��ݶ%����� �7� Y���υy!O�菱+j�� �� T���ld���N�_Y�rdٍCQԦ�H!3�3Z��7#�ԓ��H^� �RΆ���Gs��7M��d�`Ut�� �>͟� tv3�W.D��l�N�:s"J�����Z���ufG~�Ϋ�,vRQu�����Vpt��t�V�.�P/�� �E���mx�9��lk���d�q?��4f���Ih���� ��a��X�5�SP�*K"d��q?��r�qajl���E�H…��FŪ`��޻R��J9"<˄CI��� MOr2Xe�^Sqr��� �A�>�����"�RZ��BN-��B��o��[�k]�k�d6J��5�I���qAx�t',��"ª�q��$��6A2�e8 ޏQ��������1���ahv���렲L0���Y1��}B �M�BD�M����~�?R�m%|�����Ӡ��K�y���* ��U"z^MҁC�"�۰��b�n���q�D�n�a�s���:PS��]B� �F-?��oz�����2�t�G]LL�} 7��r�b%� ;վ:��ũd���}�]QPTՃ<���Ad�Ѧ�2��y{�@�PR�H� ��N�A*����̊H�Q0�����{@gc��" ՟�5vbH�d�vn!т8B{�N�ԃA�C�Lk|w�o��G"�d�w+4���D�X�L��`ٔ����;W���;���Đ���w]����aE1��(}`a�����`�`��Y���4$,��&)&Ua׺Cثt�&\�ǏA��3%�8CK�:�2����Ɨ���P��&�V�ȬA�A�g��#Sռ;���x�i�z�a��U�@��n�RZ�L� ��HdL�o� �#ӣ�� ���*0��gl�8O����@)���'��A�Ks(`H�J^�2d�z�E:�rEA�� �ݫQSm�A� Ξ:����3�6�Σ��N��j�0ʡ}���'��DH;Yf�����v0%�d�v�e�IZ�n� ˓N�'�h7�̣T<��(1yRF{�jr���DV*'3��l���`�eΪ��1N����6 ���v�����^�J�]:�N;��U�bnb9x"@<��?MVV����o�6�Ʋ�� 0c... �ue8j��YvXV�Q�̥���� ��c��?�L�Q� 3 ����yW�E���8�>>��v�Ho�#��Bq0��o:�*��D��a�� J��)yb,Բ��^���M��.A:�M�T��D��q�V��&�$i-� ��!P�h�Ƭ^9�j���r�1H�!��*�V(�]�V��������#���r-(���Ħ��������P���b��"�—���Y�ջH�QV���b�V���eKh�kyكBn-��q,�EO͚ �\U�����p���O�Q���X�!P[v2�LwL�Y�}O��"��"�ƒ�A���]WU�A� �5����(akw"P��Y�gc��M҃E��,�����a�6�����P�g�=%-4�D�a~ቡ�y!�����=�=�[z֨� ƒ$wT�L&�YY�`d�Tu�JN��i�By hn���N�w4� /��BD�!���}�K�Z��X�=�]������I��['-�k���F��Wّn5�}��Ր�<�8�:+���r5����)�4�2.�o����r3��"���1�����O��t%[x�3�����nlN�Q��a��#�9�ǁU=h���8�咑��?

�#���f\ٳ���SW1yb򌂝wF8�ˌX���.��j��hę�)��~V�R/e rwKϔ�l�x �lWZ\{� �;5O�/�7jWD�3N7���U��ID�~S��e��ˍ�JZ���g�uϟ��â\s��{�HЀ �蟵4_:18� ���&�=*k�f)������Oy�甊��� �r����H�c�@k�g�8)9���+K��<��Ί8R��9 ��j$�� �L��1mԽ3�4uf~�Y�� ��S+��Ȇrq�<%��c���Y�NA�7ö#��8/H�{�#��s���J��4�g/�x$�fi�o�� *�� ��3E��J��HH��)����\^T�|l�I�V˜F��I�ObVS H~ �wèF� � ��d`�C\�vrsbQhN�T���(�zci��I ΟC�� 5���#��>���p��"-��ϋ1�Bx������� �D�mem�����$��w �N�tV���� SnQ�p�� �`�;��#Lw��s3� �Q]p7�T�;� )�R\m�e㒍Ʃ�Y�i�LȈ���r�UB}5����#)7�����f��"����aǐM�U��%-����B {�u��hv�?*X��#������r�m�RX��d��W�� 0��"�����M��}QX����Ç�2�R�8I(3(�H�~v�k�k��`'g5rE^&Ҽ � �������?��[K�L� �v�\C���c�3�$� �]�S��B�����}� v�9"�>qaZtu+��� �����\� 4U�Z[�Q�*3�䀉ٯYذN��8�xʰ ���#�r��k�~9���壟<�+F�oae�X�Xse�h�=��p�... ��������I�=��K�9N�.IiC����L^XDB��j��Ml/}��*�l�� �o�E�7�on#{�ї"��a�6�@��M_!�HȞ ��ސ3�˴�v�>�ʾ�>?���L�hg�}v�jg�C���c��^�&� ����d��E|���0�b7�q�L΂3�WJ�o|� ��2��1�PQ��kbz��c��"o���"���}`f}x=b���f���q�|r�����߀��z}& _SW����W[yk����z?�Dž �����a�J�J"�+{,�9@��H��Ot�*�5:|� B6/�M6��e��cs����=us�Δ�CI�5�����K�۔���+��~�8=�/�]ݟ�N�(�;{��+����� m�|p��0J=��W�\��<܈W�熇�Q���\A��������D:gN�Vw��݃����r��v[�3��P�2�+t��+r0������L��w�j�II�1]��+<����a���#MnJ������H/>ѕ9��hF���M2!с=? �^r()��Ge��|6*����@�Z����U�`���6�p�q8�� �/1}�9��0����c��u)�+)|�Į�2o�����\�����W�c�.� �&)�b���̌=���zyy�k� ��9���:�����G�`�^8[7�>�� ~�.�ZQ�R���ś$C�D ��v �HB�חr �6�b%��>|~77���L�0%K�� l~��,U�Ǟ�?��(p�p������A�z�.�q<�e�⡱@X�*�0��ѻM�؅fu�)H��qfu���d�Z���ꑀj /o� 󑥊x��Ua6p�T�B[� �!}�<~�g�$N��l-�� y"�u�_'�������D�Ug���V��&V�X������}K�ՌJ���d�-��J\r���tI)^ ��Ǔ�7�\B񻒭��,�O��p�f�.MkV���d+�>�2���N]��!��d�ѯ��M�.�����26�7l\&�d�i/S�!�d+r�}K�&ߚl�y�V����V+�N�;R���� .Ȑ��.^x�\��� f8���d�-�c���Ɠ����V��*�-�:��/I�뻒����M�~ ���%V�D���0�H���5����l���`f�����d�m l�lmK�3�zM�?'��h4�j��A�Ո4���/�X�;���𻓭��-��ͬN�ϓ��j��l��ݬ��I��jߕl�l\]c��N��#���<Αl�EQ��$�e����vA��Y*9�sK�^��[�u�����V����}��d�g#^��h�C��6�3�:J�6��l�$I���iY��dk�@�`�|W���.��,�:f�/O�j3�3��s��KF�#�/ټY�w%[eǾ�l�~�+�����,يq�W��j˦�l�i}�d+�m�7��>�V��d���Cb��J�^�g�Z��'�j:�~5��M��K��1>$V��l�_�l��V#� ���t�ځ\^�4�������0��l���쮉Ջf������X� ��qM�~|zo�7�H���Ϳ��Ҩ\�*�z�i��~���3F�A����t�}�d�T��H�~ED���ݰۋ�ߕl�w������J���E���_���V~�d+�,��"� ����?Q��H�ɑ�m�����d��q�>wM�^v��蟑l�W^��F�&߾G���d�/�'�*����i .�G�a��Ȭ~�\� ��d�I}�l�����Ϲ�C��H��e�V�h����o�l5�M��f�M���w�X��/�*���q$�O�u���X��&Y�W%[�H��H��u�V��>$[���d�4�7����L��d���ґ�)Ke��*��!e��b�?�_1�_�l5�ג���Z���&[����C9�QM\�#+��$��HOY�4��T1�A>��X�R�b�;:V��`��ϊ��>/2>?��R���w����5� ������w_ޟ� P_��˯���߿��������Gv��?��?�c2_|���y<��~+���_!���ӷS�ZE����|�?�_0��O���e��q����s'�d~������{��_~pgF���;~���K�_b}���/�����~���_Xp� ���K��%�f��_��2��b��e�����H�����cn����`�j-�}� �O�[v�޻ {�+S}�q��n޹�vhկ��l��_>�D��w�.�7�TF�*���9�[���I׽��of��X�4X���C�(�T������U�,�W�_�篿��?ܶM��5�\V�����p��� Zߡ�n3����o��?�� �?����������_mH��1�բ+���/?����z���x<=�lK���_�37o�%���� J���a���m�w9�]|y�)?(7bA��6�h�U ��6��X>��r��g,�z!r,�� /~��'9㤒?8�eW����=��6Lpr�H���Po�BB���Uu]��?��ٝ�c�?gR~A���S�c�*0����s��W#��u��+���ճ�&�Yd`�a�ڹ����At��˩*�4�G8��v`{{�w�=?U�����F��"x�N�P��~�Nj��T7�MT׬�}�x��[,���uM�fP��� �]15���^/�owB�۔xq��P�����H6��j-�c5��Gr=�Kw������ڼ]>'��t�u�ƹ�{n}��2W�A�... �X �r��Tu��c>w�Jމ��x{ JŗH4���߶F(֨�^����5~)!Lj� �W���f6�8��w�Ǻ�۶��H�FH�#�����H0>Դ�=��.F���ly#ٔf)��4͜ʃcM��P�\5|��h��]��ޫ��y�����x������"�Rc��� S�"�^�n 6MHg���1Vƫ��4I���tu�<�l�2����A6%ӎ��U��f��Lɚ ����m +U�ն� Ţ�{< P�j_,r-3 lF�!����G����G2�Z���}$���ќ�ԯ ���'}O�l[@Cw*�5�!Ge?����G����l�V�k6s^��~ʆ�a����Sb���*�՚�A�a� ��-Eq�������ߕx��9�����P��N;�)_�4�PE���}�'���s=ӦG��f� �������1O)s3W�I� �Y�)��vRn#QTs� �j��/��4F� ��|�`����P3�U��9b�;��ǔ��P����1o����.�j�1A���a�9��Lh�,I�j�<"E �9r{wj[�d ľu}�n����jM����Ys�A�q,%}��׏g�U� 8G$�� ?)�J�k�v1�K'�Pj�>�g���eaG�qm�/��o��ۙI��h���iǬBS�AG{Юc�+w�Bq y8��1k�~�ԦE �%aat��!"�������`м}^�;�8��W"T�d��M�*kԜ��O#v�0�˦mm �)��a�Ǹ*��(ժ�S!���q��Z�������1١�U�k�9��Z��T31�8q5�_mv�A9�5� ��l�� "'iӓ�M<����j�|���7�E$� ���D��$1�}�8� *�Za����]�@��� �3�y��!��Lh�ؾ�M�٥�~��OZniT&��P���_��L�����2�'C���m���<1�fk�@ ����֭;�!��ii�}u(LmF�c �mPg�X07���o�T� mj��J����r�����782g+�q��blP����c��ȭ�Û�����Y�eGJ��vnδ�\��T?����3>�����@��@��m��x[n�qm�%0 ��5XDu#��@����&���LDҁl���C�.�Ea�'�7n�N8�d ^a}... �Z��얘<�&�MǹC�u޻rn���PB����z�F~D��:�����;�M���3K:�R�6Oh���n7�S˭��m��XE��W����8r���j$�$� d����\� j��� �{�9 "Qq��@ ��tu�Q�P���)����A�ѡo��n�E�f�bV�8c�T$�9 ʭ�:Ǜ�&���������92��I^��Mu���!u�cu�����7.S�AY�ղ6��29j�=�^I7�ӥ|l̲���#4-/�r�]�+����p7��_4V�r���z:a S����D>4��طM`K^���j��,E�s�A&�7��D��λ��ʜ'�ЌV�9U�Z�ͧʛT��R�\#7�w(��Ŵ���� U�� ��ڐ�3�����i]U��2������εED���"�� H-2���P�� h� ���>g�I��9`���_+IDx%�q͔&��L�~�)�6�h����z|���<�2B��g��|����6ǒ�}���1.;8����v�=C�؄���v�@��E��v���&B�d�F��L �\-�t���V�^$!�6�ۏ��Ȓ-k�>�qƚD��j����\�_׃�g;ո0ji�EX_��͑<�Tb� +C*� p��Ԥ�]��6��`lf�o�&��T&���w�9�̼g�d #�][�UhpP��"�Ƣ��ydg9# �x��"U1+��x^0�k,�R��E�"�Tۅ�rh}���6y�t �ENJ�pwD�����"]E��e����X �r�B�����9�z�(�J���أ �!J﷟��2���6��tw�0���+�d����]L��#����Y ���{��k��{9���"+B��s1������l�1x'��7��y�T7#,îN�̛�wX� ���Z�F���P�R��� $,���0��އ�ySvA�'Ӵ�v|vA��7%�ːW�c��xn�jae��g|�����/�H�l�y��[�(k�X�Jd��S����J#^!��n������u&��A$�-μ{�SA�^1�<��/А�]Ru��p r2�����B b�5�Ʉ�f�A��Z�w���D�$�JW>m���� ��U��]�_V`-���(����I�x�-�Hl��DEX��� �w��.,@�2�D$�U�c!��bZ:����zV���}cg��� {ƞ� �l� K��-�55��r� ���C��6S߂�F6�S9Hab�C������'ƪ�۞���}�0��z:�u���$.�~(Ⳣ��Q��&�E�5��HY��Yr��~qHj���2��K�r��d:D੥z��9��e\���o�<���"9�(�1OW��CP;$�dy�4�k0f�Ŷɺԭ ��4 ��WϪ]�9��sZ�GƢ����-��G�L�Q�.�<uY,�k�U�"��K�N��?�Y�7�l�I�=��gm1]���p... �Q-M8�Y��&b���,[K����U������heɉ����1�9��@l��j��Aq!i1)UKq"�DMF�&�53�ƍ�ߩա����f�Lx���:�2Ȼ#M��b�ՔPɻ�Y)��'R#t��P��ֳ�, J� NKh�L-繤 @FcTx��īa�C�,{�����K�oε��="u6=Gt^��#'�ysEG�C �b��􌡈�#�.���X����b�t{ݰuqR�DP .&��T�{�$f�`��@���~b�%���1Kn�μ�P��N��K]x>��!�u��F211ds�Ֆ.��;z��K��\m�j��H[m�U�3Dy,����k��8ހ��a�v~�i�/,�I��:�.i�6���������� ��g�r����\&`3�l���Fd9Di�:a��r��;�lYDҼ��J֏c�E@6|R�/��� g�kAf�t�deS1!C��d{�v H���ƒ�=i��ĬѝZq;&H�`��$��#A�Hg�,#��f��U$`�g��3�r��6��.��{��' �����e���3�w�\���_?��\�Ɋt��Y�'�b�*��# �j��Ws&4G�UN�hI���4s����A\m�5�H�s�}n�[S��zd��ar��a��w��6�XbV�;8�1)K��Z9�i���I�\���-lH��3�U4�qJ�4Bp�^��/'�o�*�pF϶m7FH���ܤM�� �bF3�eG;ܚ�ƞ_����x� aN�j5����P��j�1����mq]1�&x��� �ͩR!�ۏ�]��ɠ��s�.� �N�X`���� s^���"O:C���;٢h��W"�y�s����ou"D�G!A�rȎ:K�Rb2*�qC����cA��9Y{�p��M�$����9o*���]ǧ�&֬I�p�gBCOҩ�¹d��7��sj����)(��:t�F����� �c�4�F����R"K��_��|��-��9;�k�v�X�� β)#fF���@�����M�_�;"�8�ic�����#�3��D��]ZC0d�/W����E�".%�eP�"h��6�����h5Omh�u��t��Yz�N+���$Pl*؅��Eَs����� Ǧu��ش�k�S��9�GC�Ƶ�� �t\w�[r� �dy��H|��aҟ����MUul8MK�[�{�e�r�-���䈀2 �I���W{Q+��Iy ��JS��G[V�q�u�D ������ϥ��c�T8�hc2��`ҩ���Jnd�V҈YX;6�Y釦ĕ���r�f��%ӭ�H�ڣ)��%�}pD�Y�h�>���^*x�6���h-2~Ώ5����R��Qd(�SiW�>L �A阻�(�E(w;�P�����:A qX�z�J�v������Zr�� j�q��&5�) ��J���K�Hz6a��o�J ϤB�"��!�<���R ��F��ٔB9��P,ęk[l?p�zV���ʱ��g�N)֘K�V��ksd[��ˊɣ����\��T�DP����Ɂ�dG��2�&�ZM>�P��!���9���\�]W?�3���L��V8�-��j3�S����S-��̄��ߕ|�Ϫb�����,�Q<:�#+�?I�G�҈i��M�>�yP�X"~�P�V�g�;����W!�`���������j��M}%#�����IX�}A��#!JyZ���\c �����iL(�_<ꖝD�ưl��vǁ��n�9�#ps���(������.ixv�K���b����I]�K��OIَDE]'>���M-�0���2.��$ٶ�g�����b��M)E��H|��g �fJ/ʙ����l}�z ,{�qsfp�S�S�sN��P�k�������j7E��)͵5�|hJ��P�R��#����8�_ qs�Z����r�?�0���/Y���h.�b���f��hs����]YW...

����/�������(V�����������Ս�>��b��݂G)5�"r38�.������C�Δ�ӯ�cZ�J�5Z��c���"ܣ�!b���@f�j����8�^r�o�r��ңQ��7�hd�(�h{��r᛫e�F*Ii�[�M�]$�l�f ^b4�����DNޮ�O�I��$��}0m�v��eG�#[`�4����P�)s��īK�djFmf�>�m-y�+E�}T�-���V�z[��j�J� �/Ws��D�Ia���.�O�a�����a�n�rT�&Afe�>�ҝ�A�'� �!��VsnR������f�D7@�HD�,�`DZ�6��GbfR�|]�S�El����\-� ��\ٓ9�KA��)��sC��v��h���g��]jb��O3��� O�e�1ۊ�]j��;�`���Y�Y/�_�4��B���Ԯ��!�+r�(�� � �.8ǒ|�Uj�J��HXω& |˄�ň�*�h���у�0����X���N��Ƈ�ml��|�\Fæ��p�7C�^��x��9�5��s7�8��"�����YY5�C1�u�Fu�OLf1������S��ؒN��9P�L� ��:��J�"M3w45aVV�H{�q���>6��ෑ*��Gf����'!�� Wm$���Zv���8e$g�)S�����M�I|8Wf��j��E���(>lF%�� �$ 6l�l|���y='���o%\�Na�.ħ��I|߱��q���9co���s}!D0�-�5���=h:� 8 ��&h��Sbm5%��ߛ��Y�go��ۓ�f��C����ī���m��B���2^���}0���p�ܶh�bZ�HI�G'*JY���Vm����2�]0sH9jϹ60�K���1�O+nP�}�]7�p+���+�L��X�bh�!z.k��dxD�ag@�t��e06s��"�-��8N��c��L۰<=� ��/[q~B���,��Ah�Hgl��7q�~O��UU��@鎤VqEo.<󬖤V�{��_��!T����A��l?� �@fxJOI��! ���_e�g�j���8]�" ���5s���� ��Uʗ�pF�_yM e�d����uT�r�=������"ޘ�pb$�f�¸�B\�b�k�?;�lg��"�H�E;���H�i�A� U���1NwXo-w��̧';�ƙxe�u2�i��G�I҆N�<%���1�?��f�=�3�aQ�d��j�t�r���o�*�BJ�aa�/X��Ւ����2rk$LZ7Sb�n��=@܅�$W���X����C���]�o�w���s,��s �d�23f��NO}̴>L�Q���,���k7Q" �DŤu��H�D�e?#O�yOcPXWz�/�� 9r6-:�FA�r#��w�f巛V1�)l��4J)�Q�g�As�E�^ ����6 �i#��^����5�]O��J!n$ ��c��'Gt{��I��1c�2�g_C�B�H�`L�����4��ݥ����m@�.)��-[G$�P�T846F�%��\<|F�����G+Qa����ud� #�t*�- {�u��� �{\�q�N�I��O�SO ��=YWX�e�Ъ��^ �=`�=�q�� �,&Sץ��������,�UN�&��jfd�$ϞUa�����!�j?�fW�r+ۤ,�vז:�"6p���;˽��TA�J1�q��B@... ������� �OnƐ���ĝf�~:V-��$i�{B�n����bw�ml�{+�[�[�����A���>[���'h�6�٭�*)G�g# &��}I�F_�i���O�i��x@4p�2�ɘ#�"Ϝ����Ѯ��g�5����칽˧�פ��M�.�P ~�s�w� ��Z�Vd��UV�C�؅�v��i�Ƚ��Z��C<�r�f� �tn�&� �>��&呙;6ݭwV�&F�6��u��;X�]��v�oQ|bGN��ִp�~ .{%<�ܷvW@/���EE.��#�Xx ?)_~��I�\����+��Q��ST��6O� ��4Cgd�f���~�-ˀ�4֏؟Sa �9��jV!6H:JP|� 1�.���\u�V��]� yOP��.2S��P�"�eR��E®1�A<��4i��bs����i�����e���t��ۦ�R,V �ϼ���f�k�ōm(9c1.���� ���X+�4D��/�67'���Diu*윫����k����n@�<3�xݤ�o$�8�Ӭ諭�Ų(0�3�dh�C^N:���f��Ȁ��wC ����6�.J*����oW�R��1��ڎ�Ӡ�2�a� <��r%:"������᰽�Y�r͜��I��|��m��rR�0��f�_�4ӓ�v'�F\���\ށ�V�n�]o(f�uDE�l6� �/J/��(m���|ެ7��kT�gU��/�t!$�i`�&@��rD���f{nW {�<��PlU�]���Y���e�/�����<�3��5���c��[ {���]6�D~ҕn�P~��JY/T���5�X)��K�[$���P!�!��{�kY.��Z! ��-��=����WC���g"\>�X��(�Z<��N^��&K=���=,�(X�}0 ��v1�n2��u\��&�I9�K�ֈ��1��JH �5s�h~S�b���6xufa�:��;��)jjc>�=ϛ~����N�:#�N8��d>��5[G|EŖ��K�ndE�8� �wB�׏�20+�ä;��r~�I��#����b�:���)��N�Ր,���� `�)���17c; �����̏Wō��cuh�?��5"ZВ�k� N�8�2ŏ��z�b`<��Q�⃰Ûw ��&G��qص�{)�(&�a7�W�Hm �몟}-HQ?���y&��1��ɞ"��`Ӊ)%If�3ܴ9��O���c�j�l�w�^�\_?Sv��X�9想W�ja�� ���!�{^���()���a��"� )��W�%�{)�)1m7fuȲ+̳°�� N�/��g �J�=&�TB���6䁨®���'� �>���4W�&�™� s��9��)@�sp8� R@g#��������M�A�X?iO��ܭ2�q �����:ۘO��&�V�����n��q�rX���1m����l�y�M2:�ٔ���J���l��@؅s�`^��V������ՒmC )�v��z�؍.%��Z��n��H�_��`��7���-�;Іȸ�QKꙹ�c�T]a, ��1塙���2��펀�(��ܹF*̴���~m�Ҝb�M��  k�吺]B�b� �=��� ���� :s��ۭS���.L�["�~@��6�礇�+�sC�G�X+d���j#�K@�����r��e�W :��hژ���(m�UO���ǜ.�������6���s�ػ|�rɃ�p�p��{��6���mXE���a!g�I�2������� �'����je��0��ia����OQf���{�U�Y���Z�t+���sW0!����{��6���ٮ:e;�a�QmA�'`(��Ga|� ѷ�/��:�2 C���j�J9j�)�ΐ�}sH"&�l��Y��ԡ�F%nz׏���5�.����� ��w+rQvMH����e���������b�~, 'w��V�I��9��6���Q(��ik^����nhB��I��c��+"���W�c��� T�!�Ҕ2Jop�U�T!F2F���b��,���&� Y]?��Q�EB�R�g��p�?A� ]%NZ���M�&��iMj��9m�9�LӬn,|Q8��V�b���|�"�a=-w/� =�5�i����... ���Li��N��# �T�:����@Twhq���� T!�#9>޺ 9%��~_˼� ڥ����A���9�!!;|�i�����ΫY$��N煕}��l'�*L����W�B�����6��/��.����xD�� v���2z�4�~��l��A�n3i�d7O���p��e�i��XR �>�؎V�@�L�„���A����Ũ=�!��R�<���M=����b�Y��ij�DK���>vK��Q1�j�cf��_ 䉲�e�t�x[@�I=,�(Y"����J,��z��!$_�(�:ߠV7��!�[a\�Ԫ�&kbs�D�����ä��]SB�z��R��?HW��a���e�_}��RN�;8�8��3=�l)L)�B�%>�V"S�W����+�p�.b,�}k!RF ZU C�ܕޕ��&�]�,U5,DO�� ;��aZ��J�����[DUN��#�/ Q�]u�T�Җ�9u���|�H~����2T�2Ʋ�� �G����2'4��D���� � )�#��.��y�!����M����*X��K�w��� ���brU�s�P��+ɠ��(���m�-{#$E��(Hz}gl{��b�z��g�OXg���$0��>LJ�*#� q���?$B��������7Xj8���=MU;E���y7af��� ��atRI��%�����`�X�[� ���ः�Y�j���!7mvL�a�Ef��*_#)�`�D�rr J/fE�H�KWd��DFV[9�4��s�n�x��GT��M`�J��p�+��)=d�,-I2J#�y���r;&{��m���h��[07ks���fH5K��m�s��0f+�� �U�+�B~@q���t7%�G�=���1,�����X����Q>�KC�w�t����к�� �5K��:�Č~o<R����b�!xSȤ���n��Q���1Y�*+GȆr<�T�yY� x������̱7Uf&�\�M��� s΂{��'�+y��T��k�7L�T����/��һ��.p��Pot���\���p2���{V�����N��K�A��مv�����J�B�uc���E `\� %�'����:�"d���X�������LY��A�o2���V��� n�;��&�vK�G�6x�Iy���(�|LK�e���Q�aj"O�����Qvu��������$���)��~A���;��!j2����4�͖�:�۳� A$�ri�@w� Vt�zK�9���`�:c�@����X8B_� wd��B��X�bW)4�'ph���è�,�Q?���ԁWҊԆ���?񖹊��s6n�d�u�Q�Y��. Q�acl��J �Ů�nL_+�HhV�7�Eɾ ���n)��!S��E���̀]P��6L��V� ����߮K��bg���Ne� ����e9Q��%EM����ku�=�c�\��e6d��s֮����5LH2Q��d9���u��Lx)ܢI�^o� :�VDD������� X���Ms�"A�8�d1���ޕ01S���xL��h/���-�����"�񥭐Y繸��lV���#�=���wL l� �JW�D ��h��:�Z(O+���'o�D3œD�=�H��Bd��MS}fݜ��)z-�}ʸ�%+�1��2D7�� 9ߙh� �.~��P �>yQ�Ӡ�Q�b��C�dh����+����_�mH�� 'P��И�dp�(��%��� y�z1vE�c�]��ċ�'5�z�9��Q�x��6N�q1B�Mɦ�w��;;����0�Y! &�q5�"�.+���j��|[^��uF�G�k��:)��"�i�8���D4��f?�`���ؔT��46w�I�D�آ�0�#�b�h`�e���f�q�*�se�WBZ2�@)�'G�XYˬߐ��\�=%q��e����e�̨0�>��~��x����h�Z�M ��#�<����T,ټ��5�S��!�m D�*�5���k3��v���"�ۇ8�4�VK�1)u�b�v�v��\��&{�P�A��!�� T��q�KA�&^�M��!�v��%jNYp���z�垥 �9��`�߼�:}�j�O����&���\4q&M�la�Xy�V�V�w˙�_>Q�~�~��Q�ن���Z�V[�\����jdB�>�u����F7zZB+��s6�vծ����V��J��`t٦�sz)\�b����{ڂ}g$29vXŁ�D���)�Ѝ����$�RǼ,�V7�����ĥ3+ ��+5N9���6*���{T�YQ�0��H<�N��k��g' ����L3�,��臕srp��.R0�����'�Ԁ�ιD��r{����(Ƴ�CY��.X4r������E���G�X|;p!S��D�X'�����9���;O�R�<�5Tv�������AAV�2�Ρ=�(|aeF���Y%x-)�s cr����N[= �3��) 4��Ygfr�ڬuY+)3t�C������a�i9���(Q7�SH:�Μ��{1� ��%F�u��9���);{A�Nz�����&�'~����!���C��1 �^� =������l6F��"�f�b���E�Cx‹Pa����e�� �`"�$H��� ��]�tmD� �j!�"����-��W�rr����D������~�`�mgA���Uu�&I���"��F6C�xoq�Π�7��&N�kD�@DD���kn�$�9*�@�.�#|i���gZ��2�*���S����h��[�퀡*$n(���Ɖ��Кtp�Q~�k����8y��6�,���p�Q+!�ϖAqŇq�C�#��5%�,P1E�(0r�u�#�rH��`{L�n�+�9oO-*�h]:劂����&J�͑C�a�0��@L�fԢ�Cp �h0"?��@/6>mPE5���R9xZ�Y8g*�Ŝ�)�t��Q��% ��:>���|$<�mC0+���#��W�Ǭ�ٹb�zԽ�s�,$�K{� �����4e�E���Ӂ���Y:c*dI8���]a/ .��(�۟�� �����y?Μx�}���m�IހX����v%x�+�lO� r���W5C��a��%HS��{�O$����B ���`�eiv �:'���œ/�U �X�(e���%: �g/oX��E�:+D| Aa"��^1�J�a�X4���D�BXN0�yx �@$�[@�ޚ!���OY1�v��o{�=c�xA��b#eBɲB,�U%V��n��Z;�ݓd=��R�i��WN �u�QL��;��9n=�w��4*P�`����KD:*z�C|�422r�f�!��ZsF�Єܷiq����0a��ni�u�����60���G����º̍btG��ڝ�h���@"�c����f�N�!�Ob���v�y�o�5�\lijB�}�����z��#ll��E=��`�>IW�� H��:���F�H���' p�š�(M�娑�ba�rm� ��:�C�� �G?�����9ɰ�ɛ)?]�J�u,ތ�P�Gwp��q�玆�X�ȓ\L���vgج���V�bŵu)���_:����Dc�%E������75Py��������b_�~�z����p ���X�{����ƛ�Bp�'�&L�5�...

կ[ �wj�ճ9�ofl�?���d������M�|��Ն7-���l�j��"�%����́6q���ϲ�VK:����"Ln�Ԁ���%y��2a�{Oh�2΁V�P�7!�� ���.d��f:9&6i?wW�.݆'�@�j;�E- �9�I6�φ��u+��t5�����4u篬'�>��i�:8l�ճ���5��U�W���~�`=��V Jr��� j��0{��a�������Q9��o��o�s�o�&���J!�� s��`����W��������ڂӘ���� 8�`t�lĦ�:��!�$­'�Z�^!Q��aAɣ?2�f�,e����ܥ o$�W�����ύ��n)�W��o=7#�s�P��Z9�{'�MiUf , ���]迏����=����x!2^��H]���nӍ��_X�)I�$��3�QW�g?ۺJ�K��=��Q4��z���Ϊ��RIQ>f����1��VԢ�Q�{𢡵��j�B\��Ls�����:�D���=��o��8��x���V���g� 18��b>��� q���w��=�#"q���=܏�6d��s�}�~�����tR�������y���.�.D��]€9�7��?j> [Nu3 T�.���@8�ߔ��wyb��0����$L g�E� �7c��aLf��K�C0e��j�QYW+�s�D 5��D���3�VB䟒!g�{U`����{6�.[ۖ�ޙ!�K�S���h#:�+a�6u� =jp��nRTwǗ3u�����~��3��7�R����굚��b�f��za��'{�粅�4��@�7���\>64[��uc5Tn�Y�:�|[ �'��~�'lU�>Hq�FhCa��q���F~��fq�xp/ &WL����Y�h,�U��)ԓ����_���&Z&�"6����7�{��k���Ķ#���h ��c��%��Z@Q���U�c[���x,d������"� g9I+mĽ�Fu��!�b�}��VMo�,�~�ݾw^�p�-����I�˩+^"bX���xC��Rhm����Onc����B�}�Ep� �3�x���B�����s��эD�,���Z"3�*�4_Q�sֶys�0��1,dVg��[�!�Dn��Z����Ο��RZ��xy�ÊR��:�K�>iw&e!��qLEѪYNv�`�̍��#!���T�2�ۊ8�,Tfh?:�=K_��t$�w��ѱ���浚�V|B5 �x��x�s�X�!jQ�/J0›lZ��j� F֡��!��� GXC� q�G�Z^���!1W�"����m��֩-Bf���Y��n"F�9���& �V��yxZ�v�Wn[.�`$��$�t�B.�FԄ~�`_� vܩi^?����p�Ⱥ~h`A�yeLC�m��aJ��T)�$R�\!Ѕ��|�ݱ<\c5#!�fT�)1'4�,藟3�=�r�{V|:����[�0��eAMيec��1��u�# W���N��#;ۼ �k���I�m]h��k�g�%�ѣX1�r��[�K+����<�x$��; �6*� �s�m����C^sGP��uT�I�9�&jzS���Vm��Kߧl#'���A�P蝈��^... �0�n}%���J�ҏ �!=Db ��ٽd��I�n� ����\&�4��^�HpӨnEy�����܍�OWؘ'F ��`�֋$3��kC\5?Dq����PK� �I��x��z�bo�b��0�$��v �H=9�<�dI6�0����H��������{�2#�_�j�.nP��‰���`�B\9��"n�DN!���(�� �gcg�>,K�Zϣ5�1?�PmG�g5�P��02�; �|���� dA�C��=ʺ�&mlWĶlCCe؅Lno�,���h%T��⺵��|O�����E.54+n#������@�x=C��v��Shd�����?�񾯫�����6c;j� ���. By�2J@6���ހ52���1[ �4k��9�.�$#���C�� �4�b��$n���R�M3r0V���� [�޷xRw ae�`ʢ�����F$B~��Gns��� C�=��dR�������?Y��u�m�i����,U�����w�y���I�Kk���6�p�8] ��+�G�� uu��;Y�U�u��b/n��ϔe��z��JZ�wȨ�=(k,,��A��Z��������l5O�@�6fXk��O���6����~Ƞ8 z�4R ���WM��%"�)|�a즖�!�7N����k0SFCb�Bw�� �:��#�`��� �SK�s��3�@%b�Ϻ3`x�s�D�搛|� ��2�������Q~rU�N�hO��Y������[��5�I����j"��RI0� tLOAӱDy�`[?s�� �݂����-�%o�5$:DK�Jny�����B���\�b��.x�\�n�W����\ObE~�lQ�W��z4�Jv��h�Y��N�`�,)Y�g-T5� �fA�:E���`�|+q� )�PK��Đ�y��M���wm�Jl��t��\�k�M0J��^<��+K%��j�șA�"Q����z�i�F��˧M=���K�p>�7���w��x�Q�0�_��n�^Yj!+kUxTI���F'Ng��5��v\�m�&�R �hj\� ���#�8�?��T�i�^V�|� s�(�G'��,��ۛ�^�s��$ͲL_�L��ȩ*�$����y��v��>�˧��P��5��*�E�b�jN�l���p(]׈������7K=�i�^�Dܣ錜1��]��'�]/R��sÜy]3B�8�$���V�}���`��>�pP����ٞ� ~�x����3��.�E�F.��g n*�y��=m�.������Z��+“ŹI ��35C ���Q���p0�ޮ�e��Ɖ>E��6j�t�p����K�E_IU��0���o ���[�_Ni�t��jKƨ������G9�,ɢ�)�%y]�~@�ׁ���7����V�Z�n�^�J�&&η?�0n�O�,���I�;0E�U���8�j����.����hu��g`=&�+ZڲB M�hN�y��E �96J�]^���^zVf},�f�� !�Hm��\���0�3 �؍���.�;�:v+�Y��v���+bТ^�5��T&�L �8mL�p�Fh5��K������!W�D�KV�u�-I���шa8֭����A�1R� dž�t7=��&V�G/ł�W��Q�8�ɒV�ͨ��1�Ʀ���B9^�5� [;����CUeH*5�f;�_�t� Y�Q 1�f{�8�����... �t�����\Bt������P�����I@��QS�����@������^I��;�R��6Γ�ԖB�)�'��-� :�c�,T�(j\+Hi�N ��jP�V��i�E�S��D�HnJ�%]����1�4J�V����]V^3ٖ����%͝>�޶�"M7�o�Q�ѷ:_�m�`�j;����z< ���ꭤ����qA"Y؆'U`"�[�|�̣o� |Aؚ�����W87a�6E�}���R#8�V�KpA�} ����ݏ��O�N{c�k%s�f����h�Ja,�(*��[��.X���&�/,�����i��3�x��"� ܐ��� Jx+����y����j��<-��� .ib��붩�}��zOHlu�<>U� RA�V"צ}���?R+r����iNtu�G�L�>�&����:��-�� z�c�j�H�_��F\K5�:\�����9�����r���E�+�w�##��t��Z�d1�����]�k�6���l3���V?�m��!��#��EjS��������(����K��{�kv�F���f*A��T'I>{����vN\[���V��AP��bX�]&oU� �q�5����ް"������ە� {v��U���W+i��4��� �/��bk<�,�J�Zbi �nG{�!�"�:�as���4� ��9�NW� h���dU6�� ���6P�x���� 4T;�� 9"0�!�e�O��J}OR�+�A��A e�Z!W�2ʆ؂�%AdC�@Y���ONu�L>�w�l}��H!����C���3�N,Ro����q�J��9.������� l���1 ��q�Ct�}��&�{�b8����*Ǚ��{�j� �{.�B,���mn�`�q�`jc5���7�I%���7��T�D�x��Kvu�S�~o^d ]��-�^��5��V6p&L��(ߋ/�X2zA��)>�C��n��q��E���nıP����F�T�&��UJ�ޅ�զ��a�0y>�H u46'!��|=�n�Lڔ����9�!_3Ϝ�5����H1W�_Ś p���hi�G���ɫ���������OL�<�Xz1���@g��~�$�S�pj�dh_鱅Ny ����v���Ag��~ Ixr6���[�(��9��=��~����Z������U�����#\TФ&p����~Օ=Bsb������Ke�D�n� �;1� �ğUK4� �4F8� �zƷ����8m���%�a���8vK{�r� vGȫ�c�[����... �Uܨ�ZO�L⥽�.�T��v]D@ob�ھ�C�3��b������D�u\�o�M�zn���M+�T� BW���A��-5�� ����3�2��)��p칠9Rg6��v�\٬�8�1/e&��s=��y��A�-�9��w�d�T�����F0Mo��@�g+��� �����J�5��9 ��1�i�Eix� �F+d��di����#G��+�lJ|Z ?��Y3�y�֭E����Pa�b�k7�I[����iɔb�Fe{��u��w�@�f:���|Kg�):z>�(]BdzM�cc2��s��nb�.$8&c� .��Y��p0�����+ h�l��i�(���!T��7D�u��t�y��u�(U�C1�Wc���Q�i' XQ��(��(�g������D�O����A;�n�0�%�bĴ"B�Qb��`�J�#��)��(������3��ɴ�ғ3��VA�1j&H +�,�#27���X�Ak'ȵ�� � ����~��U���i�Y=�����h�(|3{ ����)3�Y}I�X}�(�.Z�G�.��wE�{��0��$ )_������f�xu���z��U��(�7�J0�}C��E�`�̝.�UK��Z�fI�}ΖH�R��j¼Q�,�<5��Je��?a�˶zw������}�r��|%�}V)*�w]��>V��X�%��Pf͐��]��f�ǝ��;�sݱё��������w�`��V x �[@�.�נJ��U��0ɷRi���M٨R�LWH�� ��� b�o��J� 63M��i���F�t™����ݽi�H�ylӥ���ɨЕR��u�n� ��%�W�! ��U�=4�� )�N�7�P%u{QL�0���`�yu�ܼZwo���"���� �'�\j���<]��М#�<=�����M{D�\J�Y��k�\)�3��QaSy�` ���5N#��tDqh����h��i�k� ���WGvN!�r$��}û�"�Ե%w�5�ȧ_ы2�RmV�ެ��!�g�)���u��hL��KK+Ѵ�V Qo����rJE8l���j`�`��|�`9[��|Y�~� � a�x�^�Q8s6%��|��xT�c���P��2��h����9̀y=K���~ �{����.�i%�W����$&�cW?�~N���O�#��k,cι����v���@8�i��{gPe��c�"�1��^�4�)��q.{d�FA��;���J��lJ0��M�����ٸg�Y��qg��H.K�q�_�r��U�}�a�1]B��zsr4�B�j;��y���v9�C��s=��?,�ƫ!pﴁh����Tj Ԑ�����Z�3�`I���8�F�(q��f#�Gi�6���rw�V) ¬��*�{�o���b�Fq�>N��m�\ڭ]��8ٯ�-��b=��P6������Z}������*�ղѨ唻\.2ޖj�Y�ѣK/l��!EDn��Ru�Lk���bR��](�v�,�Z���Ng��G��wfũç�Բ������� ��<�m��c��LYF�(������V�m�<�ݜ��Y�b�Ɗ�����ɘ;�!M�����&�Y{˫�`�(�_���\@�N\����' ��H��ܔfNBLXg|E�����0ų�zAhjv��L-E�,2��^/ �{t���Ct�u����q�y���hS�8��(�\mm=��b���.N���_�]�s�Pm���QHK̃Ѳ�t��[��Bc�Έ�2�X� �b �i� a��Ȅ��WX��9L�5�/��5\z���?��o�� ��Y�5��r���+��ȏF����u5 �e��rިP*���'�h% ��5/k2E��G���:��[�N�u���% OV�{�Y��� 0q �yw�};�˷:1n%ٿu�؁�)rr�w:0���hkWg�⺻�� �Wι���TtF�m�'�v[N�(��� h��#-�V��4e�o�ӫHA��v\*d�4��u��!0�3�r����o���*�K��j����C}�yU�}���D�ͣt���= �hw�;ϰ��7��G���^1��qi�>!�()m����Z�c���A�>e;���� �+���vR�<�GWn%F'�2��{0J�Z�����ͣwp^t`�.Rg��P��:�ĭ��ޙ��&υ`�8�e֧�����f�S���˰-0�"ĉW������"���c�Z�Ri��yU����O�D>q&3R��lk��#�b�778Ve1����D�{�&���&��8 c��\����n��� �y*��\�y�/6j��^��4��*dK�o/��)}mW��E� �+@��P0���\ަ���h���Y��ɿ�����T��J�)V.�� �`�l ^��^�¦�*?zb��r�� ���b�ʳA��o�|�Hl� ���M[Ҿ�A��/���F����$Pa�Q���zI...

D��=g�4���c�0�ʯ��� �R �e(��.�`�yR�eu���n���V��S{��D��_&�O\@8>�1�"��\gSjH>���p�&�!@ϊ��\�Pog��K�0 �ҫ���~���� "���A�@��������v��֬�1^”A8\U�!R���w�9��Q�uK<�q��[�%��Q���Z�sBz;�B��H]W��u��H�eYBS׍����H��>Ñ[P6v�������V~�M�П���͟t�(h�I��U��p�ݦ.���dU���ܗo� ]��^� ��9��m��b��;0���4��䙂xn�~�{�����c��� U[�T�7P��*�@����W��_A��p�v�i�xR �_���O��™%�o�k��0 7M${���ZH�W� <�|z�L��J���8�W�����v�+g�gQ�e�3�w�A��';�6h���Z"��g�s)"l��~>&r��*219�C7^��f�9�$��f�n�6tH����C(����놌R� f�}���c�]R�{���Q� ,�W�xkP)2K-��4LY�Ʀ���EQ�ۨW#�7m�$X���\�;�/Gt�jط�=��~����W�5��`�� n�������1��/�x�Zdл�Z� yG�YzwY�3�]+e�����^���58��h+{*y��4��]�!�90���][�4G�.h qKπ̥A&��s`�.�T�{���R�Tș�|�+xet���3$�MK��� �z�c \�H�/J�UƩ= x|���0���6˝� k���h�/��r����$�2���'wn ��/����٤�y0e�:?7���M�D����ҟe���S���6/E{w��D�f����N�)��[�d�m�dZ��:c����7o�C��hb�F 2uّ��maT�i����� y�6/m}�p#�=bQ(-����xɟ-�UJa�� u�w�vv��it؁��£n�!�rP�ӢTO�j�?��_B̸;J�ݒ2����G�@$���I�m�%�(T���;gdDs{�Vv��ͮ��X�oW��S���xi��1����d�k�j��:�ڴ��Sz��8�"tAT4�����y��xY�XoJ�А�0�����0�k�lfG{*�Rq 1���jy<��o�:���h��~�&BAДf�j�˘��xe ���;��� �jči �PP�����L��^ܾ�}̝��_�s3s��##.@?����glm��eh�tz�Ρ�p�I #��P��j�H�3��Gnn�����b� ���>%B��B�y���E��g��}-h�����kҞ�!��V��KM�����>}�M�䀮��H�w�+�Y�.�X���)�p�$����j�m� �+�c�c��>XI�h�F `7�STJ7HY1c��A�[��i���I�xNVaM��~j��iv@4ʱ��B?�� ��/6�־����Z�,3\� k%��=��>g�7Mܱ��1�S�Ժ-���5Y�/�؞�,���... ������~�Jz��J;��q���]43�l?�2�R�����6�XQ�5H�C�(�1�x��ݦ49q�Tsǝ�]w_ajwQ���o����eg#��I�w��p)�,�&1�H����y�6ե��2�Z���Т(�:�C*'?n�k.�,�{�?'�� ���H�sK�Rr�(E56�|9|�-�X����C{�g�.�^�t�~Pxg���>�T2[�Ӎ{g�êRrf�5B�چ| ���+9j�{׋�@���<���A�jvqˀZ6.,O�ЉtH%<�h��J����� H��v.���Qg�����#���b�j��]~���K �&3�z(u R+`2�e$�vd���=_��A�Tt`�*���- �*� ��T ca� ,�*���R#~�Q�b?h�Cm�_hGhÔ=��w=����\����$F�� D)6��G_V�к�� �\�\xh�V3;j�^j�=#�;=�k%���3�=ż�R8�aS ��c���Qp������R�:��<��"�R�e}ͣ��Z8��H`�k�+�Ƹ�k'�9E3k�e���7W�H.7�P�x���5�=�_�8>�S#�9.S�L��T�;4����o�������@f�R�,��������j�G��Ʈ����Y^U܇�1�r��_�������o��x�#��{9�j?�ܢ�Aܔ=:s��Ik�JΥ��q�dU68�����њQ���L��9�y��;3�`�q�qa�� �ʉ�R`σt���0��/�(�8� ��L#h�r@��.mV-�w��p��H�JU�%i��ڂ �{�K8�]����K�-�<��pN�{��6�L=A()��x|0�Df�  7��f'��5JKՕp6��%;�e�ڻ�d], ���F9�= ����1��8+�= 9Ӻ�15���wI����pcx�M����j*�UG�5� �&erx��L�sK���}��C�/��8phm��p�xq�L-�1l�^A ���CT�KD>n�a�)��6"�.���V��+�n�' ��;��a/u'[HڼҤ<�U���P5�I��6p0������UMx�9 T�?4�o��tr��{qF��5����r��^��� �J�6w�>��Z��tB�=�ϱ��i��ö�:�M1 �0LW�!A�1�B�ZtP�����ɺY,���Lex�����g�/+Q���E�`'�h�8�����/K �6��JW�h�Q�%�J� ������z�? "�X��:SS�M�2Z�n�(y�s����6F&��iF��y�#�~[�u�/157�溾2nj~�P��9� !��۞X���DaW)�{5�Dc�Ȕ�85"i���˛� ��Q�H�)������ �`��W70H��-$�A��38�ic8�ڥ��Ԗc��3p�Ͳ�9��b��n��s���1�c^ҝORl�R!=#dq^�p�u0&��o�݊-`�/&>9�%Kn� ����ڎZ��mW"�.5�1�Ah|XI��s`����`�<��'���m���y���.{�2�R-�H�S�Q�m��Ja���s�1��=/C|�0XK��`�M�!�(k��s��&hd���˫F��H`4O$���s�����q�ܢ�cG}/U�s[��Z� ��|;�~b�L@1�^|��(�+,��:,g[�%����R>�0Ը�� I��i)��O�-_�y 3��EwTp�Y�H��x�/� U����!�1�m�@{�>��ne�{��h�q�o�$�Se8%Ԯsv%���>�69���ϡETt��/��`B���L�A��&��t|�6���IG�X���x0�?z�Wې��B�L��r��-��E�A��6j������G�1^-��9sF�5se�) �A���2�2 ��U�y ��hX�����{˜'G ��*�OH9O��09��dl�c$̚��P�z�z�{I����.P ��r|��6�w>햗�p���D����(C�U?-)k�� v�9Y��xC(`W`B�1�X���:ި�jc��5��o+�15ѐb\!�z;�/8�����Ӱ���,�����R��,��U���L=�8�"�Tz�#p�����+Q�e����ʊ��k��1��9�=�Qo��]P�LF`������ϡN$Ƈ�Y�~�JP;J��\~#�g#R��s `#mS���.cV�Sr5 K�xh"f�b�}�J�̀a��S�x�0/�M�����ӭ� LVb��\^:���3���F�|1Qp�ɤ��Ba ��&�1��($6o�u6 ^8m����ql%�Q:Afb��P�����ן)!)����s�6NA���P��D��)A5O�� ��V �����[ �_W���A� ��&X���_a��v���gI�l�YA���dr �����@�AxWS�kC� '�Z�.�f�=vɪV:���n�5�i���KgB )9Fԏ'�:2'�WV��R-@�҄y�Q��Kp�qv�TQ���.��|����Y*v�G>�!���U<��JRkJ���E� ��H�>yD��V򠉞 3�p�rW ڈ��=>x�]Xap�.�ZG5� ��r���O� cRmռ�1�v�Q��20�c�E���$g~AI���q�����Dc)��q�v��-.���UwOk�1�����) 2�1H�M��o�Ց����۩wsjF��_��?���;���׃u庯�-�&F*�Q�"R������,m=oO��#C6�b�����S�|��Q ��1���j"��... ��ť�/����G*-�b�WN�.3n�r ��|Z �4�XѺ9��JDa3K��8�K�h��ūM�\�q���N��aF�R� �����%���2bS%`��8��Q�RՌ�AIǭ��$��m缇$��1?c�,9Q�����lxN'C�M�X �#,��Y��\��]��Y��ux^�k8���0F���=��N�N���(�(u�'L��#�:���b��5��ԮF�X%e/��YP/�.]j���D�����ѥdr:0#�!i@ X�������[�� p!���`�4@)G�F����2j�l��d9�_��y $���q�v�g�4i)��Fϒ�h3㗣{�-�e�Gd��&���d�n ��9���3湑�抪Rx�VZ*�|���֩;���LF�a��j��]�� ��6�YY��PyDfN��I5$�<$��k�5��`%���l�� �ã D�� s[@N��o{$�1��6�UI��u��:�M�=��*Wu7���g�`�vlNinA^K݉,>��HL��β� �n���`�&��ݟ� ����t�&@D6�C�~�&���`�rUT�t��0��Px�����s5 %��mv� @�&��:ے/�r7k�ıW��]���ړ�E����A��ntq6���j��Y7��E5FqL*@��l�|�o����G̫e��1Z� J)٢1(Ae�S� ��~w!H8��!���>.�."�?���1Rzf-�dd��@= �Z�Z ���]D�^XP��&7�*��~^G�ٜH��t�B��}�1,6��\�VH׻ �D-��o%�<�ZݜV`r>�h^T���i͡ �d8ͳ��k`�IL���F����Z����R�����Vq�X��� s�(��c��������e�<�T�ɿ@l�f]oZqG�� R;�<�Ļ�%(]� �ĝ)�������H'b �E �c"Y�7��hK�����aEV���������ჵC0q.VNp@��~Y%~��Ļ 0 حS� �)����"�,���F�Tg�Q4��!M�� ֯�xn`�1O9��է �@,(y��XRW��fcK�F}��u�AҤ �+c>k������¨yrY... P��Y�J��\�D(�4���-UV_ �.�N�!"3)��H�a����੩�Sք� =9`-(�5@���%ɭ��-{�#��=��'�ap��e�i�g�׉��&� LJЭT�{o#S�M+��}�eyH(��Ic������T0BG�x =��,���e�)b��������]��;}�W*q���ސ��]-�F��Z�s�y�н3�mCڸ_�� �s8r&���{���E�j����{@>��g1���6���b���͊\ڞ��X��Z�6�T��tɃ���[u��4���H���� ���]��HW �@�� )��Qyq ��|`J��� �F0/����yJA��v�x~�|�F1}ij�x��+E�����dO�ᄉ�#߼�w�(Ǟ����ᦢ�d"O7 1 ܊FQƒ�a��/��N9Ϗ4�v�Fᱝ9��SL����1?2%%Z����|� �i�xe���Oݽ�'��)Ro_ {F)/�yL�,����q�jT���d2�+�1��#Ic�8�B:[���-�wٰmy�'%J�}�B��K_!�0���Ui(֧�o7����F�n�5b�ޝ� ���G ��+$וx+��+�-��L}Z�����,�c��פ��[�qs;��U�,�=^�cj=0� RD�H�*uR$���D-�%�i�* �6�<٧ɝ�W<���n@f���� <�{c��H=^e�nU~� ��}�=1����g<o�x�~(}�q�Y�cT Ն�a�n�^M���|emAh��S�����0��i�e;�G��:��+'�� AD�?��h�����[���f�HE�aLV���ߍ�������C;q�ʋ�����8��6D*ut��k�(�#�.M鲗C n'`5�� � P -��)=�-���֗�s�I�$���B����S�p�V�^� ��;�:a_��lČT�֥s�^���1XO����W������+� ���gBZ �5�E[v��U��7F`k�O\�vL� �4�Q��_ѷQR�#vdDa�8aw^���g{��!�/�M����z�e;���Ay��pK�FU�xαi<2m�����@��s�I3��T��,����|������`��+X�(�����^V��@�o|}TQ�:E�;��]�Q���e ��:z+g�%p!z����÷ݜv>��(�9� �R}�aʝ�����b0�-� �\�����9~O�����>w�h�����3u������u�i[�N��O։��c�s��_... �J{���܂���E��"�� �~�͒(�P[K��Xfo�9� C��c���10��A*�DdJ���QG�n�'c �������G�y�F���+,���?i ����1N.��'�;&c��/,���;D�c��� �� p�lyl��l�o˟ 9�c �h/��T��H�. ��l�F��� �D��'�[��bU�=�ѳq0г ��<0���u��xF>?gR��K ������9��+:G�+�=����`�ӆ�K��&��} ��'��; �]�v���ɢg�s�UscUu��7�o�f�W,yh��ag���t HoH�m�1bM06�㕺OC4��:L����&�M ��@��f�'d[���U��f�)�2��^1�UhK��r��C���|^��eL��R��z �?.�vv�p�/�7N R9�}�Ĵ��ջ�ߗ��Ox��I���U�m�j�R�} �h'�h�����W :*Ϩ�qv�� �#���c�>CI���� �ɦ(�(|nL�[*U?(]� �;y����TG�/D��/�L�xn_�.h���I��e��s��%�^7E�%ME8@�1����q�k�x xxc�P�v�A(x����0���;�:�p�|,� �s� E�*~��W�< �ɳ���\���_���-�`�z����$�/�}��~E�����:��lCp$uFK*kr�Sv �ksh�v�6����I ���<���� ߠ�!�c��[��8���R�Y��kK�1�[Js*Ć���� �_J�՝U���A���Ue�N�dAt��qƟ����\�i�2��D��q6��n���b���Ѓ�}��M�X���A�q�r~r��y�V.)KC�Ăy�qy��z�kh}:�]>�7� �k���:v"���5������d׵�k�3B�<¿p{2Ѩ|�8�@m.S/� �S�_�Ñ#�N���N�ck�5Ӆa�>����H`ʹ`�Z���՞U���E��-����d�*����=$&�*U�q�o�ZԳ�ӏpVa���...

��7ZJ��u���o�CF"pY�pTu��ao�$��H��D ��?m�4�}$`<'N���_+�% o��W��LnXXXDD���&O�,[�}�:���ziii�~���?0"�������A�� �@� �:�����������uAAAJJJNN��h��H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H�H��D )����D5���:?��ْ � � �����;{�0A���. �'  �*���2[  �Y�cs~�,�'������caH�H�H�-����_����u8��� �� � ��^P���R,' � � xC��� =�%  ���륥XN  ���zLK$@$в����M-[�ܝ����b9I�H�� @����/�L�߈e�~�a��Xp��[YUk9ȯP��`�I�H@�2rJ~������~}�[��5`�҃��D��d�T꽲ޔ����^Eemjfѩ���bv�Q��1I�H��J@�Hn���+O���>�7�5��߻jۙcgS�rKM&�_���̩�rC4��y�� 98e`���+5}ǐ�k�����f<��$�����o��e�   hq���P0l)^0�?v�V �c��Nj�8���o���Y}G��zƎ�N�?���^`��A���5)�'ϥm��d��� �~6iS�+^�;�?��7��P�?�, � ��H������s4^� s��=x2i�Ɠg��?槗?����kk:2]��a�+��e�0��»3{��Ƶoz�"�g�9xE1q�������Y 0���ҧ^� s��b��u�fKN~ى�4 �NY�o�k���� ���u�����?�ۍ�X+x�{�����hи��q�`Ng����l<�x��E���x3�C��Vf�I�H H�;� ��\ �q�՗T�D��h�������=R�c�ƒuǷ��]rFayE��SR��s��Jh�F$@-E`��F��Iy�0`�*��W��� m... � � � � � � � � � � � � � � � � � � � � � �@LL�r�#��իW�Lܶ��� �=�� ���?��埙���ڵk�$@�#0m�4y����`�D$�������=Ab��C׽�H7~H�<#pͥm�?���$���DR��>����7�C$�%�������D��&����!������k�:4,,lǎ��n�j')��c78=� / ���z�������AZ���?�crG��Y'k����L ���聾gr x���6'O�l߾}hH�y��:ȭ7�On����� r��;�^�=� _4� ����T|�!/[� V�S���}p��12 3��~�3����ٳ���cA4|B*����I@$���� >��+ۇ{$�m8�N*... -���3�� l��O>rș�/7�v'O�l߾}hH��o���b���M 泞�\g݈���ok�cI|B ��"�m�UF�E����"�x�Ԍ?@�����D��⊏bxϰT�r|��vK���k>�����I&K�.�F\�>lg��-I�߯��럡)}�����}L>yH�I����d�˭����Y����E���A��5�}�H��Q�����y�eЂ�{�0Up������������#���aÆA)n��}��G�*I�����[�����WuFX�?u,�[���g's=��Ps���-f�'�(�bEܸUq��r�[dT�����p����'!�.x���T|���F����=����ѽ��J��Of�����V;v ���2��3���X)��W-;�� ����E� �����G���e��_�_�bs�;��|�Ë�-���3�qE� l�Tx5�3��� _|B�����կ~���C��I����l�}Ƕah�5k�h�Yb�A��y��+�b���c9Pv�����{���W�kVlH�u<>��a/2�L/lj���f��U� 5��h��82<_�~.v ` �)ʌ�-��(�� E�~� �De�����I�M>~�ZS�E ���\u�U���������������vh�1c�h�Ab1�A���¬q�p4^��q�.R��u�c�b|���`o�� ^oA���!<���-+����S�Qj�����kݺu���������� }N at����r���/��û��_�3#p�����yg'�`��;L���=P|$��u�J1 ���⣨�3���x���p�D��u �u*��Bk�3f@A��������\���o ����h���ڱ������xL@����p�:��pQ4� �5΂��pT�l|D���rg=M�+$ƵG���#�E(|�c�Z�߭��ܞOD2)�58:s��G�/*p�c_M��r���^r���u��� 1�/��>� ��v+`(@���ױ}y|%$$��뮓Ys�w��Б;�v��o������goC3]s�5���I�5��0у��tI�ЅQޘk�3Ù��%1�^k��[�З�t9�ț�-al�o6�����x��>)� 7�')�A�Pd���ڑ �3��F,��x��.j$ �V�x�u��) ���gLٜ��/�����0Lŗ-'�Z{��'�&��W�6�������',4�m۶G���Ц���3+$*�h-���o��V�~��n�H1_����.Z�u,X ��&@���^�'@�WX˘��Ν;CV��㗾�*��=����z�%h�A�)��_ L��ox bI��oo-7o�ҾM��v�^�������z�������O2��?�۾MyE����������-� �/];�=>������$�ޣ�@s�y�eeeۋ�J��ox bI����T���P��t��YO/�ɽ!��_�@C\~�剉���׍J��H9� O����T���>��CК��{�7�Ŵ�X��}m[�����ڵ�YK�... J��I�wk�hrá�-jN����q� ��^��I���/EY��p�+�]�G��@�Y��^&_�b戉Ɏ9��o�U�3A`��������;b��\1,�W����#�0 ���U��=z�װAV �r+��˱~O��SR�P8��� �����Ȝؙ�M��4J���εA�H��C�3������8��b���q��L��g.p��}>*�x`��}�1XN��ˍ� ���U���b������>y�Z1��AlY��� 6�Wk.걊����r&�K���芢�P|�'�����5m6D��>��-�G���c#��|)�J�G�����9� �/��#\��u������:_u����K~MeQ G���]�:wh۾�e�����e- L����أ�mq�ơ�)7(v��סeb�k��0�-'��8ŀ<6�˿λxE����ЁS�_�Ue����IJ+���(�E�R���_.��x��+�x� �D�f�HU�om�0_~~ 0g��kۅ�j����OZ��杘���;��[�j���s��2+adFU|ȇ�GO<�V�Z��L�(4p�+76K� S��ux���#��=Ѱ���G�{�}.DY܆�P��b�墺�\����ȅ���?Ia��?fEF�ܤ�0�'�$��]�{���hq]-<�M������7��\��? �i�����C_y�8p��/�/U�M>�13.?��g��?���:1�]��b5��CYrgx�o�Ѓ����bl?��R�K�G��}oDX�hHݧ⋏���sƷ��>>^h�L�����!�BB��5���q����0�6�g��������v7-\�u�Yx0��+��-?� ¬��8 ž{q�]���4F~�/O�0O�D��l@��Z�1���lb�XI���6g /'��Q�[D�Ql{_��*`~d�&����M��p}Al|��;œ8�6��]���Ko}l\l5�]����7��Cn�/y��=kS67-��=Q�v�C����qQ�$�R$��[9>XƏ)�f?]ʻe�š����o �J_]d.��m_����A�]K.6h�J�f�_n\c�����:�ߪU�+�^�дt�X�dm N�؊/wC\ 袢�ϤCqDǰp��+� 4l�S��Ă�)Q��SDv�Յ(c��| g,B��α��.2K%��~T_�a �o=�'nX@]�:P$��W*���S��-���^i����/�=��+�u�X��#`l��9z�%�k����AY�Ȕ��I�='�#C{�)f��_ ��;��L�Qyq �1N�x����s�%��}��;�\�]Ň�E�~ł�⊦.��k6��"P��?#����J ��p�s�/�_3R5Y�0��C)ʄs���� 2XQ��q{)�T��G����9�>>����@��m&qxљ(�;�06�0m��e�Hج�c��G��Ů �9��s��L0�b$�{T|�e�(�=�筱/�gg6�_5R Y�� `x�=�M��<����i��C �쀘3|�;���Eg� �Ar�v�F~V�;�\Q�f# �t�g��j �O����ˀ&... ���~��z5^������3g���1l�C��Ir��8�@-+�СCI���T�y�Y g5�jL �����ڂ+�%�K��}�7bn���;�柞�\�l��dz [���!Hf�ݩ�/d�7�7�����-�;%��Ż��x���]:��%��JQ���^�����,�\�Vxe���✝�r�>�LQ-=�/>͔S-��ca��*��K��}�n�-[�D"{d�r��N���Ԧ�]���ᣏԋ�𞠆Z��"g��m٥]Y^?��m���M� ��od-3�V7�s~PQ09��M�>�q��d��xՍ 2� %;��˭�s1~�xK��<��;]#PO" �◔����Kd�Fuzơ�����ۮi���t�ڵ bn!(�'� ��t*>���ݻ74�[$���7}��{��硆 ���X(y^� ��t�@<����Hr�L��Q��w�� �C`�G��c�� /y��[R}(�'� ��tB)�ɓ'}||������ڱ�� �)��m[����у��,Q=oN�w�F��D@�ONNn޼9��_�uS#�b�@����� �6��eڴiެ����Ir��8����/��^�u2_?�o]k6�&pf�;4}���Ç["|^���t�@<����?`�2\�=�������� P�V���&M�$$$x���Xq(�'� ��tv*~HHY��7�sb�ڴ��x���ǧm۶R��F���P|�k �I�Q����:u�ԫ�{��7=��� P��fv�؆q��۷�w z��f��i�~\|; ��y��'k|� ddd<�8tn�k�N�r �1n�������h�\ç {X�'>���m���;�W��sM����������C�� 4���G�V��{�j�J�i!0A�7� �K�wk�������!l��8� ��˨{j,*�W�e���l�yJ��{�m���oL�9 ��L�� z��u����k�={')-��Iv���`Mu�\ ��K��[�G���(kk�WP:h��t��҃XK�38�OގOʱ��>3����L��ak�+�^�A�P>+��!�%.��F� C���~kODz����U����p�0��s��y䆵�Ez���{�jN�m���&�Ťy�<�� ��ȭ��W�Ss�**MI&c���\�j�E�������...

People Also Search

This Technical Report Thoroughly Examines The Process Of Fine-tuning Large

This technical report thoroughly examines the process of fine-tuning Large Language Models (LLMs), integrating theoretical insights and practical applications. It begins by tracing the historical development of LLMs, emphasising their evolution from traditional Natural Language Processing (NLP) models and their pivotal role in modern AI systems. The analysis differentiates between various fine-tun...

The Exploration Extends To Advanced Fine-tuning Techniques And Configurations Like

The exploration extends to advanced fine-tuning techniques and configurations like memory fine-tuning, Mixture of Experts (MoE) and Mixture of Agents (MoA), demonstrating how these methods harness specialised networks and multi-agent collaboration for improved outcomes. Proximal Policy Optimisation (PPO) and Direct Preference Optimisation (DPO) are discussed as innovative approaches to aligning mo...

For Years, The Idea Of Truly Customizing A Large Language

For years, the idea of truly customizing a Large Language Model felt like a privilege reserved for tech giants with bottomless budgets. The barrier to entry wasn’t just knowledge; it was the astronomical cost of computing power needed to retrain billions of parameters. That’s where a technique called LoRA (Low-Rank Adaptation) comes in. It just made fine-tuning accessible to everyone. In this arti...

An LLM Is Essentially A Massive Collection Of Numbers, Called

An LLM is essentially a massive collection of numbers, called weights or parameters. A model like Llama 3 8B has 8 billion of them. When we “fine-tune” a model, we’re adjusting all of these numbers so the model gets better at a specific task, like writing in a particular brand’s voice. The traditional approach, full fine-tuning, means updating every single one of those 8 billion parameters. This i...

We Use A Smarter Approach From A Family Of Techniques

We use a smarter approach from a family of techniques called Parameter-Efficient Fine-Tuning (PEFT). The star of this family is LoRA (Low-Rank Adaptation). Here’s how LoRA works under the hood, in simple terms: Fine tuning updates all the parameters of a pre-trained model to adapt it for a specific task, offering high accuracy but requiring significant computational resources and memory. In contra...