Releases Gio Assuncao Deep Learning Optimizers Github
A repository to make available and organize the codes developed during the execution of a technical note on Medium about Optimization in Deep Learning. These codes enable practical visualization of the theoretical concepts covered in the work, this is part of the coursework for the Machine Learning course by professor Ivanovitch Medeiros. The code in the .ipynb files can be found under 'files' in this repository or accessed directly through these Google Colab links: 1. Visualizando Gradientes Adaptados: Code to help visualize the changes in gradients, corrected gradients, and adapted gradients throughout model training, using EWMA and the Adam optimizer. 2.
SGD Momentum e Nesterov: Code to help compare the behavior of SGD optimizer in three ways: normal, with momentum, and with Nesterov momentum. Analyzing gradients, path and loss functions. 3. Learning Rate Schedulers: Code to help understand the differences in a model training using learning rate schedulers, specifically StepLR and CyclicLR. Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.
Contact GitHub support about this user’s behavior. Learn more about reporting abuse. A repository to accompany my reading of the book "Designing Machine Learning Systems" by Chip Huyen A repository to make available and organize the codes developed during the execution of a technical note on Medium about Optimization in Deep Learning A repository for my Machine Learning Course's Final Project There was an error while loading.
Please reload this page. Instantly share code, notes, and snippets. DeepOBS is a benchmarking suite that drastically simplifies, automates and improves the evaluation of deep learning optimizers. It can evaluate the performance of new optimizers on a variety of real-world test problems and automatically compare them with realistic baselines. You only have to code your new optimizer, we take care of the benchmarking for you! Automatically use competitive baselines!
The same test problems for all optimizers! You can install the latest stable release of DeepOBS using pip Deep learning optimization algorithms, like Gradient Descent, SGD, and Adam, are essential for training neural networks by minimizing loss functions. Despite their importance, they often feel like black boxes. This guide simplifies these algorithms, offering clear explanations and practical insights Gradient descent is one of the most popular algorithms to perform optimization and the de facto method to optimize neural networks.
Every state-of-the-art deep learning library contains implementations of various algorithms to improve on vanilla gradient descent. These algorithms, however, are often used as black-box optimizers, as practical explanations are hard to come by. This article aims at providing the reader with intuitions with regard to the behaviour of different algorithms for optimizing gradient descent. Taking a step back: Gradient descent is a way to minimize an objective function $J(\theta)$ parameterized by a model's parameters $\theta \in \mathbb{R}^d$ by updating the parameters in the opposite direction of the gradient... to the parameters. The learning rate $\eta$ determines the size of the steps we take to reach a (local) minimum.
In other words, we follow the direction of the slope of the surface created by the objective function downhill until we reach a valley. This article discuss various methods to improve on this "blind" stepwise approach to following the slope. Feel free to review previous articles if you need to brush up on computing partial derivatives, the gradient, gradient descent, regularization, and automatic differentiation (part1 and part 2). ��[E�����3�k��ӄ҇��ҿ"�����t���g{���� *~��&i��-,�F$sS�˴hKT�y�rO�|���({�=�*��?��q3����O,*Ps��q+yAD�Rb9���qa߭�Rrc���(et�Sj/����ط�g� .���&vt/�6�ot����zW��YR{ˢ�p���q�Pjn�+!� #�~ݢ'��5㿒3��[sƧԮ' (��˔�4�c�5!�J�y�HE� �$A��ω!/ ,�!�X�d҆���;ΌQeɨ����I�!y��5�ZqV]��%.v@�9����*f�H�Tm��D���P8�,ʋ��X��P�a��\� �`�ᴬ%�\(�q��[&ݝ��f���~�� /��p㭄��$��LMc�5R����E�@i� d�N�:����˯���F��i��A�Q&|�k�����6DΉ撒�e㉖��YT���<�(j��P��N���W�N�K=��O��{R�{��[�9��C���Dݓ�����M�Σ3�ǘU(E��s��w�tn�hrQ��PcG}�IhO�i\*$k�T��BӠ]͖�H�+�(WAh����Ed?9K�{ �t������ ���um0~�@�4�$��+`� j��Aa@#��v�u�Fn?J��Q>��o��:�R0����á���lip��Uqo�:ހ��D�mw 5�R���~f%�Ŭ �羦�~�{���s_���� ���ס�E�����z}��~�'}�c�Ϧ ���砭��Te��dn%�@�|��p�A�x����]Uπ������nTA�^�h ����OC+����{0��ZQ9/@� �*���S�h�A ��z���.� ��2Cz @�&�]�� �3>��h�MT�0@�@�����*U�bc����@tAu�C��~lKx'��C-�(�9��\D>��yK���������h�ʁ�O�{A�����О��6�C�G!� r�}��>vJ��!�">�����G�e���D�D��iSAU�>�)�sl�y�h�������.��'>I�Bm�nj+����R}��-�u�o��w��y�wc[��:�7�wbs!�FhԂ����� ���}X����s�Л�Qd&>�w�]��ؽ@�{�\�qQ�l(�q�A���'�]MD�7�-�?���= ~K���0~ý 2���A��4 �JQ>�I�_�@�JTN���h'�#��ێ�#��C��|1�H���HK����N}� ��=�t̕�Tr�P��� �1�����/�<=�����@/�y �d�Ɛ!b������rd��YY�U�%$B]Gc?�3Q���v+��@��1$+� +rgHVB!̿����hP{�A~d�Jq��*�5�E`�d�Ȱ%��f�l_��Wi�!�E�h�Ԝ�Os�'\7�4�[����k�h��kއ�QX;{�ģR �ˀ�� Gpsc�=�y���+�m�y�#4�x�-������v�? �kU y�F���ݤew*�Y��|�J�A-�;h��j�nȵY��/����o�r�u�5@�FZ � �vHE���M�D�U������DZ�} � �:ȇ�͐ކ�!�]4��(<��!܈P��r�w�5$���TN��y�R �����p L��Y!��D�D�{`C� o�;��_�p�G� 6�b�r����K�~���N4���)| � x�����C����^�a9�=��Z8 q�����J$R'~��(�ɑ�j�߁zt�πB�����Bx��\uui��T�A��a ం�^A�b��k0� �_D��)@����ۇ� >�o~E�t� ��;;�_/G�~�O���D�m�7�(�c����5fC g�L�� B �娛����%�-�I�ݰohS[WH| > z�X�/�@��4�� ��%4�wiK�L�u��3����v�����zBmWH.0W6\@��|����I� �y����mUI�#q��)+B����GOk\[�J� �4hZ�Q��5�ӓ`å�\; ��:�5���}�=���P�d�?�n����#���������uS�wܩ��Z�A<�w�At������/�����[s�����o�$�ZR;B�HG�F��e�|�:d����N��m"ܹ ��� � �e�ꦩPGb�Q! l�~����o_�s��}J]BuH��A����'��&��"Z[=��]�� �$G�� �F]`�]t\����h*S�DZS�C싨�kF.~���b~�V�>���2hW�\����h6��CL=����u����p��`��B>����&#�P ��'�lҎ�;ߥj�_���?��o��#xC8����*BÐ�� �_��y=�zh!C�d�@� ֗�x*�1���`.�� �R� ���7^��a�8f�s���~�\�j7 ���<�ʥĦ �ts��h}�����D7W�,�9�����uy�B�]�B�2�3��#4�`�9P ��Hjb{$+��TI?w�{`��AC���ԑ�]�9����0-�6�s>A&Ȧ��� �/��9 >���En��+���S���|�q�f��Y͛��'m��I������Φ��=����k���g~���������Ϗ��g��?~��}���ᦣ�Q,Z�x� �$u �r��"����[��k�|q���x��⪼�//(��;,����s��9�bwNP\6�tbP\�O��&�� >�cB�؞۲�Y�Ŗ�F�93(6e�e3��<�!=(.Hk�ӂ�7�S����]��:WP��5(֤6�թ�ŪԠX9~�X1>(·�<%(�� �e��8ϱQ,u�Ź�Aq�g'K��bqR�8˾K�i�E�yq���a����:�i���Ġ8%�'NN� ��|�+y��Ĝ�b���:~�8>�ߐbM���yK|C�-Y�/�I�A�.v�6�UL��m� &Z�bBlP�fNj �&��/���,�?=6X�e�5fjM^�7";����jý�7�����c����a��ZM�P���H��+x/� �.����3��ekk�l�V�e�Q�=�g k@����A�P��5oP���U,���j�뮬�Pm���z�v�@�E�U{������Y����E�� �\�U��.�\��G}R�ݜT���������ηv� �/8a� endstream endobj 186 0 obj << /Type /Font /Subtype /CIDFontType2...
�(�!��]@TB{7�@g ��M�>��g�q��N�E� f|� �<B�}����0��?�~瞪���:�bDAդ�{f�ro�*�"F�Y|g��s��G�${��+�~f�$"��ȹs���.p }�`�ə�W��C�/G��ܲ啗mx�Lj� ͜"z QB�㣲镋�.���� �^ܧ"'�<�כ����2�V��2�9�5н���1�4��ȫ��%Q��BniP�O��i��G���)q�%�RF�K��Zz�Y덼�u��)�K�z���lZ��S �Ǘjh)�C�^0��_��֎�U�-�Ν>��m��kKӼ�-���%>#�4��9��tP�!�6�ަ��m0���R �2�kh=F��^bT�%�y� >�7�82��8���+-M5�f�W͋J�H1�>��3���#7�����`��3�kkjq�p�H��!Fmr[@��X�h�K�ߗ��>���)#ǖ�CDD�L1��S W���J���6ykǖ�%A39i�%�)Y�jqi�����M���<�n�b�n:� %u~�K8L~����T�4�H��j��S��=��I�K ��P��o*�;�E�T�<d�9��i3#��@Tp :8��F���3|>�O�0�a��e3�֫i0?�c~k�̢Nr�4oj�ƥ=�Ѵ��h��ʦ)|�&gfTe�����"@����A# Sd��t#�o�� J�3�g�d�������=�&N�TT8ik��q�y�ŖE���Q1�zP��oK��ݍ�i�8m�uF4ʣԅ �Ǹp�+� g.�Ѿ���pCs�un�5�ԧg0�|^�dgu�ُ:�z��'�ؘ��~9��E���E�W�����y�eś ����>·��os$;u�<�V���X�~�܅-�?�bᙏV�G�����v.����2��Z�`���.���Y���Ot����¡y�X�Y=�5�����^���ۍ���:i0�x{�����x�r�ߏ�:q :Sr���( J��`=,�@G(�q ]y�+�A��]|r��I��x���s����bC�}�t�﹜�� /��+̻�J��$y���]�.��0X &�n�MI��G����M��QK���°�����Y�ٳ�;�Uh��R���V;�U��q�� w�ЉR*c$�8 �H��gDp�����#8�dl9�5�;�\�Y�h6H��3�4�m�/7�1�B&[:��V�`���X�8PƷ� j��.��o3�N�Q���d���tH)��`}��.���\���%�Gd�)��"ɫ�A���z���W�&�]��MZ�|֟܍�T��w�j^����S/�h�|��b lK�e��yl��g�'���y6�X����A��qv���_~���|I������-�����mD�d��َ=��(��yQi�<١c+ѕ���!W _w_��\O����칸����d^dQ+VU-2��ɒF�'[��p~�ܻ��l�۞։fd|gu�tq�?��v'�h%�[p���JЀ�v3��V����^���`�>�i����'���]g�kֲ��L:����gyl�ii���#o��t���\6�� �`>2����4'СW�f��T�ay�IT"j�����G&�%抄۩��~{�����J��z����Q�!.�g{��P��������Zy�����Zq��6� UK�>F_�_��g���R���JVU��� ;s��g�͟�~�?��S����=�+�>s�Rz����07"�F��... %���d ���'���_h�$����+X9Ox��?D�Q}~m�}��r@؇��bt��[�Å\;�"��C�������b������h�=- h���>n����$��9��@+��Z��ܡ�p��z�y�� ��߯���O�^=��Q���(/K%K%�Xq�(~���v95��f���,�����$�6�ZR�-|*q�=�zbl��mCcK 6 =���X#;,v��:9�GG�ƑzבX�ա�U�!�X����X��:���k{T-i#��- h>4�vZÀ����8��;�tt��4��d�����H�nh!�tO���;��i6�t�ޘNnE�\��ȩ�?��s�=���/�g���O ;yRlȚ�B���5c��}��=h&��9��rJ��te���OȘzF�$W�-86�Ek��(�x��<�-���gN+T�e@����g��U=�* �r�%�Q���f���8]2)Ԃ&�d&�-�ޟ��-:4� z�zց��ʝ=��ЭY34��qʹ�|����X���F^[�`H��8m�=w�[��m�����Pt��^=v��W��|�FNbYٹ�4N����?`���:OlX���WrŹ�Y���[�I�FU�ȥ��8 �V����٪id?�:�8�j�1�ݡ�d��^l'�]�:���z��YS��o�t�F:W�t��ܲ�W�<�@n,>���w��5��t��з��s2����'�V��T4j� ���؆��)���U\�T�� �KF��x XB�6Z6=59�=~T���P=-���;]��k��Q*�۷߮�c.������tgjdp�ep��q�K�C?V��dGF�p�"!a��H�Ҏf��Qϑ�{�&x�ڸ�|R��v�}��UP{%����3���a�F���D6 ��aTj�������� ����F\��� i���<�8L� �V�pK����xR�/���9�9��z�r�v�C3�`�pN:{����E:���?�.7)(|s�@Є��Sh~("��Z�LpX-� &�m�/u']t]�h�[-�2�����f�`BD���JKI��6B�FWCQ^�Dm6�'3^���̤8��nA>�J+݆z#�b?�m��6�W:W�>�dķz�b�%5�iV+-鶮K��f� j`s�˯A���炟#Dŋ��j�jǛvA�,2�=�{qpP�����?����.�-mI �o�����6����5��M!�����"�e]�����Nw8e�ѹ��185�(j�#�L�@��.�Ɲ��ࡳ�()�mbd�p� eQ���khH��N�5W��>>� �VL���ܚ��O_��J�H�y�n\�}�s���{w?�|�s�ݴ��,y��������r��ny�%�X�?��9+)��;\��C�`ը9+U��������t��f3��<$�/�XA�@8E�V��RYS���(ז?° ��u'c�c/;c/�s=H����-!�P#�k��t�A�\�oG��7��>�R7�`�ޟ�� mO��e�x�)�R-@M59�z���<�i��� �-/�հ��B-�@^%h�( �FHm��-7*+�`[�Pk�`reH���l�[�`�<�t2�[]�4��!J9�O�F��h�{�V���6�n%��+֜�Ċ{�����QO�"�zZ��Cŏt���rvC]q8�y�#���&���^{;\�xBy�����ݍJ$�����w�0P|YxU|YzC~3"]dm�^b�g�a��u���^�g����B�W-/�IX�hEZT�?�xɰT��CQU�E�H����H�SE8[Tk#O����6�I��*��Ī������RAeh�.� �K��LV��p���YO��k��`j�!��߳��]@�D�b1���κ����Q��� ����͆fB� �GY�]X�Ĥ7��Էom H�\ ���@�/��G��'�n�C7��(������מ�ݲ�����7��lּ_<��}࣯�Lz~�S����81�9��K��]\��|[�)��|[��v^ �0���VpEBmሪj�7���YA�&b����bׄ�S=)���I�ȕ���������+��K��?����gb[i�8/u. s�|Wis=3|�ږyV��x�?mS�ǘ�b��y �}1�Sjѽ�i�ӆk�a�|`y �l]�Z PM���b��Ů.,v-��&Fb*"�f�o�-]��� �W��t�Og�`��(� 0Z(�������(����(3���u�&P�h�%�����ϻy�7V��,��VΝ�����WKߚ7k�-�r_~�<�5�Ъ�[�o�zN����s���Z !@,M��m�/�F��I�E�>6�1�p�������T hg�$3�c���,�iˬX)�Ra��\����[���iFp#l��9�7���$�N}b������9"V/q/��� ��F]E<���T���zIT���F5�jX����j��$�$Q#5�k�uB��b�� pb�#�dzGw�s�N{^�������8NźN�\cjC;^w�Ι���ɬ:'�8�npw#�� ��{��:Õ��p|QQ�D0�{��%cm��ꩌ�$�� 8��J�gR����ބ�sb���6��/^�5W��>��:}�ӹMe�wΣ8A�ø� ��Ӻ�ͺ��J f�X(uDt?���:t�� � "� J����b�%����:�lڍ0���6/��ը�qQfq�|4b�c$@�3� ��r��C� D�s� � S�V-+ZS�������� ˊ;`� qJ/��e(�Fs�^�����ᱻ=v� �Fwӊ������*�����R(��;i��S�k���{4^��J��J�� T�b���9�� y���w��� .g�K��B(��N�]%����SAL��&�~�6��@���9��H`�&��}�[Z���tm�sw��:_}۽�X^|���w�fm͝��xx��z��sK��N��{���5 �'<�lh�n�g�<��W@di��"�W��EGhÌf��#!��H���⩄���5�f0;��B���n��Q� j�Qo�j��3c�[xL굉��D_���4n��\����-���?�e��9W�T�_������R��k��l� nz���7`��S�X�`��%�%">��#]/����E+����%��b�4�k=�����,�KF�A���'��9�|#�? ���-��n��x�� _g�Y���G�?����4c��m���n ����Kg�P����� d��S����k���H�V�3ҨW2q�^ ���z��~t���o�� ����|�&fqW�懮L\�1�6tg�a�s����}��N�����m�q*f���Jr$9�����h�T*�zK��*�dv+�D�)�Ŧ��x��A��n mf��b�םg��*L����$c�$S}I�Ē����s�N�\�~Ô_*� ��-�]�Q�V�m�ن��k�ĞGjk�DQX"0 \N�ʥ0d�� ��-�����8�/����]����=7\�?O�x�����۟[~�&<^���7�y�50q��|k����>�Enǯ^�jٵ�ѵ[�R)� b��O�XX=� H�"��\y��#B��Mr!Z�D� B���������o��������O?�?��}��K��u�=\3�����Dx�L�������<t�^�/�x��:�^+]:�5o����@H3nN�,���{po��q��،ޑۗ���t �&~/���� "�%%9�䈔�y1 ��� ��*����2�'8�F���ƣ�� 3G��T)����s��?��͝�lF?~�fr���C�c�� :�O,O,��:�䘀������A�g��Z��<]���y�m�"7m��u;r��SO�� ����� ha�<��N�AY�V�t"[�GA���xI��X-�+)����Qty�j�r��R��8bs����C��:��d�u��:����fq��F?){�1{yj�ډD�G}�K_���u�����1�|뤾!Ҷ�)u�9``��+�ٰ�!��C_?����Q7^�{8��;�ҕ��Q���-<�Z0|~0�%�����hEްk �4]i�S��������ϰ^ez��� l���֪ʮ�J�ή�h����И��}k����>��m�PO�q�Y�℞Z/�Jy�Ҩ���io ����1�" x"�Ͷ�h�����O��[yo�,�"�<�Z�(IV�e�*a��;X\%&Y=��p��۸o��YJT�ȉmd�� ���N0!{�al�]��)q�����<���|ƺe��]:l��Y���k�Dn��%"�����n�`�PP��@���PG�Q�>4���f�9�d��J۷Ͼo�*�XW o���;yR+��diO�W?P�m� ��?��]��� .ι�\�L�8R�G2��:�������D��='�⽹�d2^�������A���r�"T�oߍx� �������Y�E�m�8't��@Yd�U��"��.PV�)���eS3C<� g��VVVT�HQZ�8u"�p��0��t���D+uz���\OR�-���Eڏ�Lk%2�=���K��Ւ�Ւ�jnz�d��W���Vʁe� �Pԇ�e*0�ң�1�̱B��3Q�ԝle f��SY�.�8%����uR�j[i����L�~�$,u�zI;3Խ6�k��vƻ��v���>F�%���c� ��Ij�ۋf]y�=�6�fm����/>���s��/O... �C�1c\��?ۏ:S�)G�z����:���BC�4�!;��R��@�^��8�m�>>�i�#�ْ��s��� ��A:�x� {�^�X�/���ŕ����O�(J��xi=0�Q;�� Ʃ�d��g�&��R>�裖��-Q��bGGٓ2^"b��tx5�6Y�\�ˊX��&+bMV���Xe��2�N ��_v� �Բ' m��ƠF3,���u#֘��1p�`>��"�'ZSZқ*N�I>�HlEq�s��p���`�DH�q�l�qBU�qT�A��=������R�����M:��_:�����l�����F����n�snC�<�/0�/�5~Ůkn��x�U��{ӱ�H������E����/j��헽4�{�����~h��;i_>�P|i�VZk�}no �Eu�zP%�@�Ey2�L6�L�]�0��I�HC�LK�~����" IW2m����6۰�XX�YX�YX�Yb�Q�v]�*��.��f� f��l8fck�-���lS��T��[eÙlO$���P>�9��k�����2��P��s$��Uh��r.у�=�J"���T0b�Ú ���ɬ[�>.�J�}������ځ���m;�����vT����ey��L$�eQ�XB�8]�M�� 넭�X������=��Ơ��\1ظq����(4�7fsk67Lfβ�~�����2i{3جن��u�]6! �2�f~h{��5������1;�3]�I��k�ն�NQa��j��цC�|ԡ(&�)&�)]���T��Ys�̔�F\�Y����8��IA��>�C�l̍cn�=�����8� ��45��L��e6E��m:�eX��m�&:���y6�}k�<4��UZ0����5�������Zt���`�[s?�r ��0��%q�Q��_FV���b_u�z)�������q�b�X��p���_#<�- *�k�x:r~DW\�.F 0lvX3.�u�˅%O�Elپ���?�� �=��se%<HQY8�� �G` _GTU$��HV9b�� ���Qhڅ#/\,�m�^����"qRY�G ����M-g��:A�3�Ag���S(��Q)���?@x� ѡFX��$kur�=�{���P����@"]9��ꤍx |Zg��ٝ5�f�jJ��2n�p���x�S)�Ƭ fx�+ g@�>��җi[[\�ē�uO����$��L7���^7-̦���8�8�?ɹ�5�g,u>Dnɣ���*ȇ��:� ���_�%�xI@��VL�$ǨSI���1`�c]��.��k���O 6�� �ϳ��Fm j]@��h��-�~"$:�~�r�*@Xis� � �e��ɴ?��/���Ew +� Ld�bG�BT��d_+��]L�5DG� ����l�[�J��91�������4$�N]�̴�b���J��<+VR0��"�(��Z+�3q����� z1-�5��j���v �eL���#�E^&� id�n+X��!��g9��8�������vCg�g��͈8d ���J��)�Y/rp|�Ve��]�/�-����"�[_�h2�,��H�v�A��^Z/o枕Dq���8Ad���K�����㰎 �eE����5�O��fq�!�� ��.��6�YQY���1�z�[��۱�"m�p`d����b� (�X�a��L|)&4 �h:�y���A� �� t2��X u[=�E��i�\�7�u��ɪY���g$�...
U�A��J���x5��6�Bknr{6�}�^�ս�}H����c������Ɲ�Ǔ��w�������gFt��9��:�Gg:�y�pm��2�2o�F�?`x�.�I�ʷ���S̳r�t.���B9���O.�b! ���5��5��5���7R��b���>Bl2��ЬfؐyK�I�@���N���%�⾑W���m���j|��dz#zߖ�C�cw��5��\g�^{�[�6����[�x؋����SSR$��%�_L�oO�'!V =���@��? 5B�(�&$&��n��rk�����S��}���3����@("�Q�0P��}����S|�W���eR.� )���(OrN�N�L.�X|i�Ғ9�,�� ��#w���k*h `�����3��� g��'P) x���9�<� H�s�@� J�QG�Ҩ���n��� 8�R��,�):n��pS���6E�������P����T�/�/�/�S�&8�st��X�g�܌,Xͦذ�d!��� g����f��D �jjZ����T��-bA� ��-H���X�T��U 3�?�������ڂ��I%����7��ܧ8���S.��X6�*s�e�xʡ���=��=}hg��]=����v��"�a���l`���&�m[@��|���bǮ���ų��ż�RXeVJ�,��%mR�1�m��Mo� @?�� ���؎��']/*�� KGa ����(e����/"i�8rql�eJd~d��Ծ�q�����9G��K� l����q:N�Uq�I<�SE�'���Q?s��Hl����x ��0�]��L5�*��GS�GE3�\4a��djXtFdc�X���R��$��(��(��(��"�������~{,�u�h�ǥ�VX�q��LO�j�� ]��>T=��/U��6��@&nb���n(�q�fv�ϮG2�YZI1��TmC�A���Np��2���D��{����Y>aD��k���G|����z��\/a���/{�d�ksM��mk�[��k��~ˆ�f��S�_���E���v��BnD�L�H�qRJX>L��!V���,�IXL"bl¹g��+1+�s��E�b�O��r�� �"iDѐ���C��s Ҕ�K��p��yh��D�$R&Qf �����4��I�Q&J�r[���reɾ����䐞�c�WY����gyf�Y��]�Q��tQr%��r�m��.���[����;�{���G<� �BJ�����>�Sh&���Dz�aN�l=�eI�|�Hc�7�C�F}3ҀgY#�KY6�߳�����R��"�#EѰ,�у"�/��"��J�[VdX�g�NJ $ ����g��,�3F�_c���0�N\�Y�[>�p�� �|j��is�[N�(�z�{�z �����56K������|o�Iܹ"~M.,ضl9�O��Zp(�@��[�b�D�¡]ғ�@� �����F�a b/0�� �d��ƒ�T��I(^�RZV����?�r�Rge!o�%�A�L` �,`"��x���~gu5� �I���:��TKM�є*��U�5>Sua�D�!=K��^b]e}�����~5v�k=Kk�}��Ԋk*HE����~�}�=o6طڿ�s���,��0��ks��q=NgP�Y��]�����y;�(����F��m?��=���������}"��b�6�{���NӹP��gp���RW0G�1�H�<��R:(L'P�ƌ��R��ի���6r�n/��\�X�WjkJ�Ps�jN0S>0����N�ΰ�S4Q�+Ӟ!38C�(����,e͟ ��dz�'��=���,}U<... �5���.l��U�Sw��:�;5t�,^Kh6�3�(�� �p�g���k�wk���;:c/^����7,ݴ�܀�5c�'��C�띷~���w�Q�44R�� ���/F/��e��2�2��'\�̴�^�- �����(U�e��#��D����9�52t~d�kJp\d�k~hZd���{��hȇ6���ѷ���"�u�F�h���C��Rb"{�κJ��� ��7FY~�*f��u�G� ���6mf2��^J)��i�a[��f$S5t�5��q���)lvU����N�Z���V֘}mH���n�a�n`E��8�Ӣ�~��ɦYd�(l8�b#����c�O]gS]aZL!K��F��`��x�8˺��3n���T}����w�������R�~������Xk��w,O�?ي�A�Zqy�����=���+�~��7�C��.�� =�Q�#�3�+��>j{�&�l嶖`{��f�C�5E���:"*�����s"R7x�'�fm���B�0kL��01yđ�0�ѻ MG�k�!ԩ�uH/�C9�8�PyFU�X����������y���^�v�K�*2܋��8:�UH�Ot8��N���tG��$�،���ȇ�hNQ�D�^Mq��St�q�+W��i�Dž��Dm5���8Ma�K'�n߰��uɈ)��}� >p�{xmӼ����S�6^���,�� rc��A��No�XO�%�a���`Q�%�Jd,}=[�z&J�,�-'�y��$���K�W6�l]��*�o�oE}�P�����K�T̑�ǧW4V5W*�2�m�2��'z�ȶ��[b�X��^L7�vt�'Cn�5!q�CJ"V��NVw���L��2 I�X���F����.!����������c�X����]��0��o$�0�)�'�ٌs;p�3f*f�T̘���U��aG��;����0�eð��d����(�wwD蝍��͎`�jq��sz�1m*��� ��� :��haf�Q�GM���4���e��;���Z3)�� �gm������;^��cW���?3�/��C�ܸ|��n���3cr��;q��b�����s8����������K�vB}c�߿�@������x%�Zn��ƳM^��/;�N'`��ǢZM�k5��Mߨ��hM*zuߚ����c ק���rVzh�*ԃu�4yf�+!z�ad�xhG�x����G-����.�,4�G���oM�,�m����>�G<��=�K=��=I#{B�Z�oN��A<�-����� -x3��[�I�@��an�(�1��[S�̠mJ?��y%�����i�h��v��6��(M� Sm�>�יp����U�7�/����k獹������>�h�T�i� �ᄆ�e@��йu4�I�Y=HT#y��t1��=mN�� �g v��Y)�Rb%��i�ҝ�ĶNsb[�1a�0G�c��J���� �Բ)��<��������S6*-J�rX9�HH)V(�ʆ¦#J^Q���%�p�H�M��7a$ "��RR@�~#�·�Gx��?��������G� �ϳ��Uz�) �T��f�T)+��3��:����1���Q�م�G ��� ��߫[[[�8p�˧N�R �����]_�ř��3�i����{3�ϼS�|�3(ĉ�d�s��)�9Ŝ�e��&���vb����T�cn�{l���F�&,]�g��`���/�S��BR�NR��Uq�gD�SRRΈ��z�h[� N���e�C����ģ�Wҿ���^�� ��Z�Ȱ��r�H��x>i$٪��< n�(�7� �o�]x ,��ڐ��4#�fs�|Z��Id� �H�F���z4D��A�f���%����8��$... n��`x���3��n�p�Y�p'~< dž���0\�~|�8\�0\��џ������pnS�����2'�W=5�٫ν�� ��9��̒�/<�xѶ��5cǮ�?�d�ԝ#t��ڿ����~�CjQ���:��}������| ?������Y���� q2��C�R�N�rI̍ݤ䬗�����#]�����L����FC�歌r ��sA��Z��B:��6Y�|� ��\egs|� � ��3����O�7����ϻ����{�|jSӅ�-V߸��=�s}�Kn�L/4��5�� +�M.-3��I$M��$&Qbq���G��E#J<%�����Kf�,W�Vn+}��B�k�M��^ë>� a2��VS�)�u�e�u�m�r��8�C�A���CO�eQ��QR���tc��`��d�x��sн��{�eH���E0J+�B;#�����ޓ�_i&jW��"%�fMXI�T�U*C��ʚ�>�}H}��>�*EÄe�3�0&aOĸ���-Ƹ0V�`(�`uw�X���,)Z��X���-9J���`�¸M�id��X�;�2�U��&:z�����c�i�Z�&��B�6�J]/[���^�#����o|e��źh��>_��m�>0q��7����p��s�d��V����8}� W�M�/)r����/�2yå/Rl-�O*����7���w�u�q�̷e�h*{1@�F����@41�V��9�Ӕ�C��YZ *���Ԙj�1+�K�eH��@j��I<�g��"�K%�M�*��:Θ����� â/�9_'�Q���Z�+XW��(�!sQ��6�G�=�_F����:6��YG����Z{��4����M�~� �ڃD ���⪪�n۱s�;]ݴA;o�d�Z,]��km�/FV�h����/{���(D�C��s��D�cz��I�q���Y��g��C�>��Ƈ���%~�h���g����y����Ly��<��0�S�3��oL�&��q��G�hǖQ�%t,D�6�ZB�O�M��J��08ѥH�{�c�A��+�"U�ia\Be��L*�kQ� �2*xV����{b(U�T�)�V�9�kv��FD��<���0���0�Je� 0U����}Y��*�� \���/r�fi�8�;���^8t�"r_玻z;���$s��h���@������j9�Ќ~��L|� �qS���L��-k�/�H�E,v�-��Y�=�ݳ�Y��K�F%ΌJU�͙Q�ﭑiA�;`� K�Fg�h��C��L�$Y�|P��!���sjP ���+)5�j� �0u"�H�I�,<�̑�(K�u�:�L^�\��«�J�i��Fy =�ܫ���P_A/I��7���C�}��w�:�V���S�QJ���F����W#@�Ԙ�ԧ9�"��(�:؋�� �-�6f��Va[� X-4��4� �����QϮ��~�$�IE�(�����ޙ�WQ����3sg����n d�^ ��Av$�K kT��AP.��A��WbUEm�����A_B@ �`]���֝*Z�Z�E�����33��R۾����n�;�9gΙ9s��,3Wh|������?*!��>�J��,]I�d��qo����T�����ޘ�+��>��嗹9G�������)��2[�C�}s��mpvB��%�����H/E���ٿ�_�.���+�⣷\2g�|q��j�y�FI {��m����?�HX�nϴ����Dr���0A����gP����)r؝/���� �x�[��������2bυ 3f���R������"F�ߟa��R�����imNH(FX3��... �k!+�~�6��M`����.h;<����|o����<G\������r}.���_"?�c��読���?�!�1l0$3;��6]{��vF�fT�f��[w�� ]�v�u�$���7'#��O���8]T�%�c���~,v%�k9���[BVy�����ޗ]�+����3�ܶr�'�28�]�F��!3>�_�>(]��a�{u���#a��;M�����f̈́,��K���kR9�����.B�1~C����/� �ׁoZ�����.����� O�vK��vh��fn�T}��B��j�l��4ޤ�)��u֗u�|��2��F]bח��t;o��s�jLi��֦���Ǫ����O������R����17ݿ��Tko���͞寶tڮ'�����MZ&M���Mh��˃��l�@|�P�[���9[��k�����d�r�^���P_�8�O��̙������ΐ�m'�z;r[�*��(`�`& ��{��k� �z�������)�ez���09�Vv��9c���E��7��Tw�~ �T�[L���.{�@�u�_b4��U���+����ƍƳֻ�����h�5�^l����TO��멢q|��A����j�`#��9}:��?Z$�dۣ�a뗶;�Dž��#&[�S-�{�Qks��_�T�E�Е����-���+tr��� ��Km�S;�?D���B�լ�K�I4�lu���>��:��hL�\'ч1è�1~�:p"h�ӭ�6�>�c�1Ga�u<&B��5d ����s�Mi������ۃ.�+d�� >'��x���U�Z��Q�ʣ�bfh�G����P���e�F_Y�xnt�M��X'f(�N��kn�R�ItІ/��k%ϑb��������|�Jh�J�{ԩN���An<_�N0��}˵Ų��T]�e�G��u�F(v���x�Rq�/_���Zƿ���R E�a���h�˱,.层O\q�YNUzVq����}�xW��a�������xUCq��>�l���/C����x��1/[���m?������e�=�~3_�e����~�>U�Gȩ��F=�h3�x2?�'ֹ�g~|�G��|��\�����D �ː��hX.g��g�j�f|�> �cz�>�j�ј��?��^��"5B���6���+�إ��ƳE�f+���(W������+���k�q��X���9.0r���k�e�ˇ}�5�Q��Q�د�_a���PYo��'s�����o���ݬ�o�����*�~�}��� ~d���)���X'�\��b��{!�U��_�}׃���T(�m#טz(���˲]!�$w����߄=~����W�?��(�������~b��Y�]���� ���1B_��}Ȑ}�r�� �S��1�F��P5LJ���U���+��!t�E)���)��l�&��^����P�S!ώ|�+� y,p5���Vg*ߑ�2�&C�Xm�Z�xJ;�+���kCQO�N�_oϷZ�&�{Vݯ�r��X��/�������.�m�M��:�&��mϫ��9���+�X��^��l٦b/ ; 7B1�����Mn��M�|�h�-!�s�⽡��w�x_���\(�MW[�F�� ���k�z���ָ���8�w`{0�w�X &C1&Цk�)�f"�ss:�1�_�,R]�`��}=t��Si�{.
{��0��!�W���1Gs�ڃ}C��k��{�uezD�,~ ;�q�2s��>_����q�>ڞ�:S4n,�n(�����?�����$g?W�ϱ,yl��X�0G{�=�� ��Xp\��X� x�*y�k��xP&/w�E<������9�i��2(�;�� ��d(�U�����.B�<&�$#�G�GL{��2���XI藍?���̲-���xX��ˇ���gem��� �����u���q`��v��9.�="���C�>���W��+C�+���k���)f��**;E׳�Δ�;I���|��,l�c����ω��)�s�>v��pl��Hxޤ:X���[�1�D�� �olR9�5�_���QY�'����g��c~?����cA/��a�>�\;�O��kD��oʾ2�M�?������R����Xz��9�_srD]���1`��2L������R��M>#�c�ǀ�lj��g�S(���Atq=I����G����:=g��>�{;Ԏ��3s�X+i���a��3�b���5K�l:���Dk{����phKi�u�]�]��g��=7��r��Mþq\z���W�%��Xc�/8;����s�Ǚ���Y �Q�>��f���6�e������� 빗��#������r�:������x��r-���xea����K�S��[Xca����������84�9���`��S��-�YWٷ���U�-���#���}���@<�7�5������m �q���l�r�a�����ڏ��!�W�}���}4���;���f+��b%,O�r ���:�zkCS��4��8�a�iY��b����}����=�7F��9X|=���?���OE{�z��A�'��s�犟g��LR��k���~�m ���c��� ��}�wܯ�P�9A�K��Ɛ�i�>;�h�{(>����Ex-�~ ���+�u!����x1��m�W�==�4 ��wh�o�5�h� ��� sk��/�{X>��v�cco`�9��O�K����:�ه-�˼��(i~�÷�u���F����WBq=��!瞣�����X��G�;^S1�|��?3��a�C��r ���b<�+tBю¦���\]�M����&�v� �����n�����1�<����P�]�r����m�ñ��1�/�n�>��!|��n�E���W��{�=Z��!�3��<� c���#����D���6�s����~�ˢ|�Ѭ����8�}� ���=F�`����� �_ �>�~��� ��l��s^3�|T�-�j�b]���A~���/��C^��+�m/�d0^��5E�>ȱP>'�2k[��4�jӵOq&|p,��oȚ�"����s�8�ң�e2�X@.,W�Ǽ��@Oۡ��5z�p.���a�l��,O;� r�s���8+�����^��2?����}5��^M�pr�{����xm��.��<�'yp�ُ't`{ԥ��3�����箣��J��cn�>k����ڌ��m�3��áhS �9�;� �״\��Gg����=������ޏ�}��_���c+ �1�=ۦA1�ssܖ� ��]�9>N4�o j��%��=(���h�P� �Ux��u��������w0������P�]��C��'��e��ޡ��~ߊ:ȫ�z,'��F�A��k���3�l�m��Z��*ݳ��c�|�e_z��l���b>}�UG��-F|sܚc~�粸絠��dYp�zI>���FX�ۿzI��;l���4j%m�����+���%��5���J(����~���U*�p�7)��bl+�{uz>� ��u��l ����mb����c{�{ ����쇡.�q�s... K)�9&����4j�����k.����էXk�kc]Ʈq{܃dK镂C��� �)�t���e�]־g�������5�^�.�B�F��b*�_cv��_Q?�.%۲�vl���}��MC������t��Km��F��_� 3� ����R�����}x������w��W"���e]� j�6mAݮ+K�� � �Vv��ԞT��̿U�ם������X�������_�8G��~��u;Ɣ��TL���v��|����#K�U�zL��ޥ��%}�i �~T�.���T�,��醕A�+��ڈ~��c������zL�>�风��2g��?�2��c�j� ��v�e6d��ߟ��a6 ��Q+S�vno?6��1E�qⷁ�f��ܞ�i6g���h�o��� 1N$�y6>+�6*� �K������%�T�c\��wg��Y/�e|����4+ee�[$�ׂ�ž/X?�L�&�Y�;��1�A鰥ȫ��OC?�z*���dۨ?e�jQ?��<�6����g@|��/�, �� K�GПr��i�� 5��<�/=L�#� d�rC�e�wu�>����/�\��-�/���?���6�+P��� \����G�f��OO�W�=��)��;l��i�ݓD�h�����j�i��=~?N@U�o�5Mq���uu�k9���VY�Ŏ�t�蹕9�2| ~�����ޗ]�+ӗO?s���QCFx��O�~�̇�� Bf��xf��W���_c�@?�#��_,d�;�g��v�y����y�,=g5nk�q�������T�Q����/��e��Clc��S�-~��d�����,��K%��1�n%��'z~�����T����w��.s�����hI�N���/��9>��)/��KB�Y���^O�B���t��T_S�X��6���}�����+�}��o0�K����iN��&�~���Y���wu��M��s��Y}-���#��������X���^u��֩�^?W��6�ϧ���[_E���(��l1~����f�[4Z��_����7X{�G�Jq�d�h��.��b�Ϗ�~,X��Vf���m�z�6�V~69(�W ^���g���t��q�����w���Z+�m��G|V���9{>�[��su���5�\�� �b�d���V��@�S�1�7�=[����ʗ 4~U��;y�z�)��_>������}�_��I;����~��>' �A�6^m>� ������Q8���u��x,�<.ّ�kF{�U�+?� P}��hW�:��8�۱���9������w���������u,��L��/����鼻%��wY� �ҹ;��H[���'�����'�������/ث%��dF��L�X���%�Kq~t��\�'�/��]���>����,��t����E׃����F;��kO�8�=B��B���������'œ��=�4.ד�����+e���� ���йJ��`\��OCٛ�$<�>����M��q��y�� ��gM�ޒ���z6�b�^+��Y�Q���o��}����b#���{����흂����4Z߽+>od�)�S��=��D��L�[p������������{���F�1;7�>kC��I��x&k2�-)�gx�!�wE97D���q~�sw�3w�\]:W��եsu�\]:W��եsu�\]:W��եsu�\�hH��ҹ�t�.��K��ҹ�t�.���2�su?Z���ҹ�,����Apeҹ�t�.��K��ҹ�t�.��ӽ��[xT�~L��bC5>y������e��1��hZ �?���������^MR�ii#����1��z��~K���c������Q�]�ux$�iJ~;�� ��)�����1;��\J���"W�S����JүG�ꂪ�� �Z/�����G%���͟�v�(�ڕ�)� �o#�ͣ�,����,�ϣٜ�sR�e��[[败|]�Sٷ#�<��|�(�c�DY>��)eI^]ƫ*�}Y}��P��k��Ge�]�]I?!y�X;�k_�]�n����~4�є�z<��h�{=����ñ_M��D��#Q�&��H[���>j}Ph>,��,t��̴J��=�����u���+eޝ���b�i6{��S��<�h|_���$��ח9Iu.�su8W���鿉|���d����ǟ���Ld������H�oH�'�lٙR���թ-K��ҹ�5��B�;_�5��O�����!�����3�ϟ��[����]�����sCq����J���m+�����ʽ(��@��� :/�}�A{������W�|���>?beζ2���M���E��Z����t�w����3���C�?��T?H}^|-�kSm"�(�}9|:0e�t\O�<�^���wx�B��jW�=����U���&�'^�Y �wcς��]��c��ߖ��H/Py|�4�{��`χ�c�ঐ1�����{Z(�;����Y�|)h��A��������ϧ:�... �i��pڭ�)r� h '���f#-p��u�"a�:9L��'a`|E��x�OB�仓�j��h��TF<&:5�fM���,�FC]H�����0�9S�RxJT����,���eu�����m���*��?�ϸ�2_�Hcg��1)� ���q���u���ٹ�yϜ��Ni�x�g*隷�ȝr՝���6���m�����0���ڞ�i���x��;k&�vu�ϟ�=ꥭ[wM��=-0�T;��q�k��M6���6}ֆ<�ڶE{"to����$�5� �W�B����Kߕ�r�+a� ���sxx�ȶq��v9q�ȸ�q�81���%�H�+�a��e�<�͐�+19���&Q��3G�]�4=�O�m%uGFD��`��㢣���:�M��ݱ��RXf\ʐ���~\���7�W�G�X��9��v� �P�_ul�m�Oc�:v} K�kww�ͷ��G�'ن��Q���T�7!7EC�� ��('�7P�����KBFt!�7AO]Hh-H�O'Q�����>ce�n�R�h4B4��`��43�)=}fzzf�{;�Ʀ3M�]�Ni=m�#�����ٽb��\,z?�콾��;z�4��1�7��E� GwRnuM^c�2~��UL���{��e� �͂C� �ϵ�qN�wg�RYW�isFU� �U�o�q�Q<6:>*"&�l1�l<6�ن�kc��m�D��,*2��,^D��j�H�H�� �ob-�*�ζ̨qQ<�������4;�j��y�Љ����Ą[v�i䟳yW�5{zlމ����=?/쌼& ?}�#����Kccz���իGv�#�����sa�������sˬ�����|�-��մ��/��E[����~F$���v;V��07�(]~Th�;�,�/ �4� �6Ds�T�,�A����%�����Uh, ���5�[Ҙ*7$�c��h�����4D�+��h��<�';03=�2�~���g�]L��>u��v�} �*��*�Z�i��n�I�m�jU�U�cͱ[�#��i��vQ��p=�MF���œ��1g1�$مT�:欴��y��;;����m��"�Yoxx�\p`� c߅���S�3!��M�Ա��$d�� �阰Z�IJJT��J]�CoR�0'�y�Z�����>�f��sڲ��><���o�ܻl���P���,���wb.��.=�����{��� ��1?ǩ/�/5��%�� ۨ�Q����}��������o�!�þоп �=a}��E���0m�u��تDal��m�Ū��>����d��B�I�~!LČ��!>&�3c,�^Q�;d�mJ���iv���@'���D�[K��Rc�R�UF��U7�����^��>���̹���|�V�˙^�{���}/,6�lز�f��-b�9�/�*����� 6 � ��7�ʈ�HKbٕ�8J���e �<�ٕK�%�^Ϙ;�j< J%HC���E�c��mB%�i�����&�ߵ�В����o����㥥�K9 } �/ǜ�Z�����\�o�3>��w��3ߙ����z{��fnC��~���#�"�~�&Z��{�'y�V���~�N�<�d#kG� �|����Td��'Oγ���� ���$���V�W^�*uE,��B{�F�/��])�����F���g����M(? ���Ҁ1��&��y؊:Ɖz$������������(zy�}h�HG[�Q� �HD�J�^�� QVR�?��D~7���F�eY�F7!=��'dMC���Y�1����Aȿt$�S^� "xd_E��0�g>�WÀe���������\!�a@�J�e�����@�Ef�I��h��2�#�|-�D���Z��ga+=���>���*ĸ�D��ό��yGЯ���N��V2�B�|m'�A<ȓ�EL]Oӕ���4O_M�"�xw�'J��P��J��r�50u� �a����ԡ~FI���m�'16�ļ���i�"0���i�5�L!��c�y�����e�N��tH���y�9�����l�?~ �:��S�~�9!CR�LȺ��·�Ac�$��J�P �e�~(ʇJ}����!tC{Y��p!��r-,3�̍�$���t���(+�g��Y�^u �:�R���z���Щ���� d�Э���*�'ezX9,��F�[��q�&֣X&-k��n����Rס��fz�F���U�ӣ4X}�+��ڭ���������a��i����`.��wm]#`9̮C[���0��9��y�0Ӵm�W�W�m|� �C���y� ������ ���6�����a�@�k�r�e�E�Xt���5��Y�e$�t��t�M}57����Ƒ㔊�����D�/�����{K���`�� ������s���} �Bg���@���{��M���8�B� �>��6X��W�X�~�J�A� �g��v �OK�^S���.��Sȱ"�a��6R�9������v�U��4�\�]�, u�3��^��8�5�����גo�U^3��k�͖�W���z��K���eb=�R1Nb_ �ZM1��ò,ڗ��(iH���:��z�"�U���XwOԷH�B7��J�����i����\���.��(+e�0�8�U� �tE�<2W^�d�'�<������w��R��VK�b�D?xO�51�X�Iօ����I��}|Y�uR�o�qR��ҏ4�e��i��j9 r��:��u��H��#(��n�����N�O?R��D�UKW[�r�U�_��q:6��h��J��n��H_.��G��QZ���D���.�G9JqBGпҟ8 �f��h���;���0��(�r=�Fx���8��%��D�H*��O��Cb�X�nq�}�2H��*�A��i lI��(=�;) ۣp������|`�2��,u�.��dzRp"�����ko(OP�:��״�g���`��1� �.�j7��R���ܭ�R�,�}�K*S+��@�T/MR �����G�i�4Z�?�Z�c��O����4��r��_�x�Vʖ|- e @ȼ����Ww@����W��,�)������O��`�>R��7���m@ ~x�g��=�A�2��gK�2@U��� Я���z`�jO� u?Z'��O�]��x�(��������e\˦>�lz���d� ���;�e�P�R��A],V��?F�(�ŵ���:e��r)�.|�Z���e��O���)(�W�؟���`~���_C�I�>��x���kY�q�\��)I��� �җ�������c��p�@ <�����i-Ѓ,��P?By... wճС�=���y�K�tD��wzi����M/�X�Ɣ�2vOR=|I=����Iw%{���Iw�H�M�%�����s������� (>�O���~�col�Y]:�ܳ�]�'[�v��;�;�)��#yxI�n!HE�n��G� �jUq�}*�A�#P�: �b�Br�b�'����_. �(�"ʅ�S�,�.˩L��=�,)�u:e�T�#�̑TjQ��ڴ4Y��d�+w9�`]dE�d8d�NV�`�1O�"�f���Ezʶv���_&�s�Llg�I�7?� �Y]�9�_(��*�t�L*=��N�{Np:k��N��V9a�TA�O��qM.��w;k��p��DvwWq-�P2�����boww���⊺����Z��Vy�y*������ Γ] ��E[���V�;_�U2M�}Yy�� +����:�&:\��RQo��/zw����=*�-�&���*�"+� �@da���$G�Y���R���-f� �Q�B -�B���CK=)�G� U�ǟ�f��̶Sɴb���l |[��Y���>�gΜ9��Ϝ�YD����K=��B�MUW ��@��ȴڐ��z�����͉P:K��Cq������Qav]R����b_��o�f��3���C�8�̮���8� �MJ�F u�`4�O�Q�L]��2�&�&�&WG��Htl[�7s�B��g��l�%�{�۶�l�F��+�g19^�6 z���2k�%����,�̄��9�9&�̜#����c�?g>��O"�� endstream endobj 202 0 obj << /Type /Font /Subtype /CIDFontType2 /BaseFont /MUFUZY+Arial-BoldMT /CIDSystemInfo << /Registry (Adobe) /Ordering (UCS) /Supplement 0...
�?&��h�%���B�u��g����i�a-Ǎa6v��`L�_Xn�b��n=�9Z91N0�s��L��HHX��ȭWs���[F��[1�$u�e� ,9m ,Lt5f��\�Bw+���q���5���8T[H�kX����F��(x�tvjqH{�IE-�Īc��MVn��_���� ���e)��bT����C�$hX��DL�Ix������kc��3���`'�S_Ǹ���B�,z�%���E^��r�W�V�Qj����ؘ,F�þ�B�=h��#("Տ�� _ ������V���&�Q*�`��e��O������� fx��� ��t��ct7�.k"�Gi�m�2��놇�v�QB6�댈�0�@{� �����ȇ�a�� �v f ��^�����L�/$G��*(,�*M�K�9�����s4o8�pC��q���6w�O��^��Es�\��k~�j����s�H�\����oii�����bp�L18���h�gɴRw�� f�LKm���;-�҆�Դ�e�,�Gb8�J6�ɜl2�edP�q�Hq�Wqby��v�Ls�'��g3F�SdCf�M� ��H���S�ۘ�p����S��+�}�?��R����u/��{�� �..�<aG��uc� �-E7�|x�j%���.|�8D��J���p�Ag��h�v��q��[j���W/�3�I������h�̅5�k���ƽyu'���6P"�yb�q�L?(�Q#�K���ݜM� g��2�,��!n�p�rj(�$��-L���\�Hg�j��CGy?�yֽ�����tK@�)P��O�d4� ]��EC�� ��D�/ ������27KgC�]ׯ��S�`�N(�Gc�����+�C�Ĩ���X�BO��'�� &�~+H/)�\ۘ��f[�l�̎���y��=>7�wpυ�}x ��e���Z� ���$��^��X�U����YW�Ł�'�|�����yt�)�&y���( �c���n����t%]!9bKvF~����+8)t��M'�]]��j�����w��h�>�]�(�M*_6�� �͆��JoPexL�y�l�C&k�0h�(��v]��8�uf���a2)'�8�6qb �9��/�Y��v�2�Լ��*��=�����-X��&�Ɲ�ZR�䎒�o�f.�����Y���V:s�?��u䞹E�W��,紆9Β͏�__ ���ð�TrQ�gbr��IL���ۣ �� ��t�M���]�ǁY��W���-�ˠ����Ҳ�R��p�=�d��߶�u��_�j,���w�Y�������ssW�W�O����h�n(�w�ȁ���?wZ���`ފ��m��[�T���8����\���q쌗����l�,s_���u�]�_�y�����r�Y� K��6�� �s��/?��n�_ח��*�u%$5�rX Q��(3 �F�{��eR8`��v�0�kR�y���7>}�;/�d�3�=�渾���]��w������k��+~�QN��='��_]��֟������������>dG�,�-+�DLO����2%^�-f�����`�����(�U�l�Ïӭl0� v!��+\�XK'U�'����/&M����T���q�'��66����]���ِ9!����%>������G[��)���8w����{���uo�,���i!uR�'Ւ�:aQfl�<��... Ma�$��I���ba���O���۶hh�٘ӿc�{4!�Ƣ�i�$�&��"7:�]b�Ūޙ���ϩ��K�r㡶PA�S�鐏�/�K�c�آ����8N�7q};5FX�k��|��X�j�dD Ӌ�Y"�m�gaK�,�-�����|������^���+}y�������J��))[�ə�`�;�s�[/�W����]��ӽ|S�����g���`/#�Yԇ�fd$� B��.�g0>�#bq�d/�YQ�*3��9�"��Z��eo�X�d��3+�;�Z��9����m�,L�[Y�xV.B�,7/��5����e�~WC��� C'�7�`��7�Yߗ���� <�<�2U�gB�<����i6 J�e7�>��KkR���+��O?�eN�$�?)�ܼ��YO� �c �J�u�E�W�kz��4wO�ӯ�w=>����nTY��/�� ���b��>o��o2��&g�)�uɸ �dD��}ƽן'��\�r�uI��.Ѹ�� ^�s�ś��@i�3���� ����[4$�j>�^��RV��8L|�z��l�{:�cX_ 8+����?���E�2@+[���3" ��à�.��N� *ߧ-R?p+`�H;�?H%�>r��B��`�A%�h*��e�"���\��C�K�h�8J��L�R��;�%�A}�?��-t�;����]p���0�-��6�Ur���j㯩�Y�+^"�g���Go*����Sl��2ۃs��"�Q�։i�+/������� G��/���׀i��d�Bvtr�xH������u�3���#������=�=�N Ԩ��HC�a�} ���T�@��vpG�"���FDZ��t�`���N��br����B��8��0�+GD��z���b�6f��l�k1l��'�59�o���_=�頄�����6���#�S �+��4��fX �/lfX �a�:�[�t � �f:�\oņ�b����t��t��d~�x�|~�ǀ�V���3_�����q���݊�w�h�ۻ}3{g6��U��0o¿�\�O� xy����c��_�����X��:�~�*MR��.JeT/o�z �z�%J�G��������)��t-}J[�.5�]�����R/i��m�9ѫ^brbw�wA��m�����_����l�S��&m� �ģ���b� g0��M����ʰzT�^̵k��.^U_��~ ����I����ɛ�����a>��>��;=�ݓ��s,n�N ϫ����5�C߸�&����HzU��Β?Uw���"r�i�`��`8�Dd��1�̈��w���F�F*12���3�2Z��hb4�i�c@|����{Q�;�S���(m,�<y}����(w���'� �Z~� ���������7tP��C����>�W�SX�ȿ����i������x8N��o"q.!����8��*�揓Vq��Y%�nTDX�̀�O&im�~x�:��1}Fb\=�o��Sn� ���m ۦ��u�:�%ɴM|�* i�G��p�Qu���... There was an error while loading. Please reload this page. You can create a release to package software, along with release notes and links to binary files, for other people to use. Learn more about releases in our docs.
Ranger (FastAI RAdamW + Lookahead) is currently the fastest optimizer. By combining LARS / LAMB, RangerLars (or Over9000) is also used. However, it has been shown empirically that RangerLars doesnt achieve good results in the long term. https://arxiv.org/abs/1907.08610 [Lookahead Optimizer: k steps forward, 1 step back (2019)] https://youtu.be/TxGxiDK0Ccc [Lookahead Optimizer: k steps forward, 1 step back | Michael Zhang (2020)] There was an error while loading.
Please reload this page.
People Also Search
- gio-assuncao/deep-learning-optimizers - GitHub
- gio-assuncao (Giovanna Assunção) · GitHub
- GitHub · Where software is built
- every single optimizer from every single github repo I found throughout ...
- DeepOBS - DeepOBS
- Deep Learning Optimization Algorithms - Marcus D. R. Klarqvist
- PDF DEEP LEARNING OPTIMIZERS - success-vera.github.io
- Releases · gio-assuncao/deep-learning-optimizers · GitHub
- Machine Learning Notes - GitHub Pages
- Activity · gio-assuncao/deep-learning-optimizers · GitHub
A Repository To Make Available And Organize The Codes Developed
A repository to make available and organize the codes developed during the execution of a technical note on Medium about Optimization in Deep Learning. These codes enable practical visualization of the theoretical concepts covered in the work, this is part of the coursework for the Machine Learning course by professor Ivanovitch Medeiros. The code in the .ipynb files can be found under 'files' in ...
SGD Momentum E Nesterov: Code To Help Compare The Behavior
SGD Momentum e Nesterov: Code to help compare the behavior of SGD optimizer in three ways: normal, with momentum, and with Nesterov momentum. Analyzing gradients, path and loss functions. 3. Learning Rate Schedulers: Code to help understand the differences in a model training using learning rate schedulers, specifically StepLR and CyclicLR. Prevent this user from interacting with your repositories...
Contact GitHub Support About This User’s Behavior. Learn More About
Contact GitHub support about this user’s behavior. Learn more about reporting abuse. A repository to accompany my reading of the book "Designing Machine Learning Systems" by Chip Huyen A repository to make available and organize the codes developed during the execution of a technical note on Medium about Optimization in Deep Learning A repository for my Machine Learning Course's Final Project Ther...
Please Reload This Page. Instantly Share Code, Notes, And Snippets.
Please reload this page. Instantly share code, notes, and snippets. DeepOBS is a benchmarking suite that drastically simplifies, automates and improves the evaluation of deep learning optimizers. It can evaluate the performance of new optimizers on a variety of real-world test problems and automatically compare them with realistic baselines. You only have to code your new optimizer, we take care o...
The Same Test Problems For All Optimizers! You Can Install
The same test problems for all optimizers! You can install the latest stable release of DeepOBS using pip Deep learning optimization algorithms, like Gradient Descent, SGD, and Adam, are essential for training neural networks by minimizing loss functions. Despite their importance, they often feel like black boxes. This guide simplifies these algorithms, offering clear explanations and practical in...