Gio Assuncao Deep Learning Optimizers Github
A repository to make available and organize the codes developed during the execution of a technical note on Medium about Optimization in Deep Learning. These codes enable practical visualization of the theoretical concepts covered in the work, this is part of the coursework for the Machine Learning course by professor Ivanovitch Medeiros. The code in the .ipynb files can be found under 'files' in this repository or accessed directly through these Google Colab links: 1. Visualizando Gradientes Adaptados: Code to help visualize the changes in gradients, corrected gradients, and adapted gradients throughout model training, using EWMA and the Adam optimizer. 2.
SGD Momentum e Nesterov: Code to help compare the behavior of SGD optimizer in three ways: normal, with momentum, and with Nesterov momentum. Analyzing gradients, path and loss functions. 3. Learning Rate Schedulers: Code to help understand the differences in a model training using learning rate schedulers, specifically StepLR and CyclicLR. A repository to make available and organize the codes developed during the execution of a technical note on Medium about Optimization in Deep Learning. These codes enable practical visualization of the theoretical concepts covered in the work, this is part of the coursework for the Machine Learning course by professor Ivanovitch Medeiros.
The code in the .ipynb files can be found under 'files' in this repository or accessed directly through these Google Colab links: 1. Visualizando Gradientes Adaptados: Code to help visualize the changes in gradients, corrected gradients, and adapted gradients throughout model training, using EWMA and the Adam optimizer. 2. SGD Momentum e Nesterov: Code to help compare the behavior of SGD optimizer in three ways: normal, with momentum, and with Nesterov momentum. Analyzing gradients, path and loss functions.
3. Learning Rate Schedulers: Code to help understand the differences in a model training using learning rate schedulers, specifically StepLR and CyclicLR. Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users. Contact GitHub support about this user’s behavior. Learn more about reporting abuse.
A repository to accompany my reading of the book "Designing Machine Learning Systems" by Chip Huyen A repository to make available and organize the codes developed during the execution of a technical note on Medium about Optimization in Deep Learning A repository for my Machine Learning Course's Final Project Instantly share code, notes, and snippets. DeepOBS is a benchmarking suite that drastically simplifies, automates and improves the evaluation of deep learning optimizers. It can evaluate the performance of new optimizers on a variety of real-world test problems and automatically compare them with realistic baselines.
You only have to code your new optimizer, we take care of the benchmarking for you! Automatically use competitive baselines! The same test problems for all optimizers! You can install the latest stable release of DeepOBS using pip ��[E�����3�k��ӄ҇��ҿ"�����t���g{���� *~��&i��-,�F$sS�˴hKT�y�rO�|���({�=�*��?��q3����O,*Ps��q+yAD�Rb9���qa߭�Rrc���(et�Sj/����ط�g� .���&vt/�6�ot����zW��YR{ˢ�p���q�Pjn�+!� #�~ݢ'��5㿒3��[sƧԮ' (��˔�4�c�5!�J�y�HE� �$A��ω!/ ,�!�X�d҆���;ΌQeɨ����I�!y��5�ZqV]��%.v@�9����*f�H�Tm��D���P8�,ʋ��X��P�a��\� �`�ᴬ%�\(�q��[&ݝ��f���~�� /��p㭄��$��LMc�5R����E�@i� d�N�:����˯���F��i��A�Q&|�k�����6DΉ撒�e㉖��YT���<�(j��P��N���W�N�K=��O��{R�{��[�9��C���Dݓ�����M�Σ3�ǘU(E��s��w�tn�hrQ��PcG}�IhO�i\*$k�T��BӠ]͖�H�+�(WAh����Ed?9K�{ �t������ ���um0~�@�4�$��+`� j��Aa@#��v�u�Fn?J��Q>��o��:�R0����á���lip��Uqo�:ހ��D�mw 5�R���~f%�Ŭ �羦�~�{���s_���� ���ס�E�����z}��~�'}�c�Ϧ ���砭��Te��dn%�@�|��p�A�x����]Uπ������nTA�^�h ����OC+����{0��ZQ9/@� �*���S�h�A ��z���.� ��2Cz @�&�]�� �3>��h�MT�0@�@�����*U�bc����@tAu�C��~lKx'��C-�(�9��\D>��yK���������h�ʁ�O�{A�����О��6�C�G!� r�}��>vJ��!�">�����G�e���D�D��iSAU�>�)�sl�y�h�������.��'>I�Bm�nj+����R}��-�u�o��w��y�wc[��:�7�wbs!�FhԂ����� ���}X����s�Л�Qd&>�w�]��ؽ@�{�\�qQ�l(�q�A���'�]MD�7�-�?���= ~K���0~ý 2���A��4 �JQ>�I�_�@�JTN���h'�#��ێ�#��C��|1�H���HK����N}� ��=�t̕�Tr�P��� �1�����/�<=�����@/�y �d�Ɛ!b������rd��YY�U�%$B]Gc?�3Q���v+��@��1$+� +rgHVB!̿����hP{�A~d�Jq��*�5�E`�d�Ȱ%��f�l_��Wi�!�E�h�Ԝ�Os�'\7�4�[����k�h��kއ�QX;{�ģR �ˀ�� Gpsc�=�y���+�m�y�#4�x�-������v�? �kU y�F���ݤew*�Y��|�J�A-�;h��j�nȵY��/����o�r�u�5@�FZ � �vHE���M�D�U������DZ�} � �:ȇ�͐ކ�!�]4��(<��!܈P��r�w�5$���TN��y�R �����p L��Y!��D�D�{`C� o�;��_�p�G� 6�b�r����K�~���N4���)| � x�����C����^�a9�=��Z8 q�����J$R'~��(�ɑ�j�߁zt�πB�����Bx��\uui��T�A��a ం�^A�b��k0� �_D��)@����ۇ� >�o~E�t� ��;;�_/G�~�O���D�m�7�(�c����5fC g�L�� B �娛����%�-�I�ݰohS[WH| > z�X�/�@��4�� ��%4�wiK�L�u��3����v�����zBmWH.0W6\@��|����I� �y����mUI�#q��)+B����GOk\[�J� �4hZ�Q��5�ӓ`å�\; ��:�5���}�=���P�d�?�n����#���������uS�wܩ��Z�A<�w�At������/�����[s�����o�$�ZR;B�HG�F��e�|�:d����N��m"ܹ ��� � �e�ꦩPGb�Q!
l�~����o_�s��}J]BuH��A����'��&��"Z[=��]�� �$G�� �F]`�]t\����h*S�DZS�C싨�kF.~���b~�V�>���2hW�\����h6��CL=����u����p��`��B>����&#�P ��'�lҎ�;ߥj�_���?��o��#xC8����*BÐ�� �_��y=�zh!C�d�@� ֗�x*�1���`.�� �R� ���7^��a�8f�s���~�\�j7 ���<�ʥĦ �ts��h}�����D7W�,�9�����uy�B�]�B�2�3��#4�`�9P ��Hjb{$+��TI?w�{`��AC���ԑ�]�9����0-�6�s>A&Ȧ��� �/��9 >���En��+���S���|�q�f��Y͛��'m��I������Φ��=����k���g~���������Ϗ��g��?~��}���ᦣ�Q,Z�x� �$u �r��"����[��k�|q���x��⪼�//(��;,����s��9�bwNP\6�tbP\�O��&�� >�cB�؞۲�Y�Ŗ�F�93(6e�e3��<�!=(.Hk�ӂ�7�S����]��:WP��5(֤6�թ�ŪԠX9~�X1>(·�<%(�� �e��8ϱQ,u�Ź�Aq�g'K��bqR�8˾K�i�E�yq���a����:�i���Ġ8%�'NN� ��|�+y��Ĝ�b���:~�8>�ߐbM���yK|C�-Y�/�I�A�.v�6�UL��m� &Z�bBlP�fNj �&��/���,�?=6X�e�5fjM^�7";����jý�7�����c����a��ZM�P���H��+x/� �.����3��ekk�l�V�e�Q�=�g k@����A�P��5oP���U,���j�뮬�Pm���z�v�@�E�U{������Y����E�� �\�U��.�\��G}R�ݜT���������ηv� �/8a� endstream endobj 186 0 obj << /Type /Font /Subtype /CIDFontType2... �(�!��]@TB{7�@g ��M�>��g�q��N�E� f|� �<B�}����0��?�~瞪���:�bDAդ�{f�ro�*�"F�Y|g��s��G�${��+�~f�$"��ȹs���.p }�`�ə�W��C�/G��ܲ啗mx�Lj� ͜"z QB�㣲镋�.���� �^ܧ"'�<�כ����2�V��2�9�5н���1�4��ȫ��%Q��BniP�O��i��G���)q�%�RF�K��Zz�Y덼�u��)�K�z���lZ��S �Ǘjh)�C�^0��_��֎�U�-�Ν>��m��kKӼ�-���%>#�4��9��tP�!�6�ަ��m0���R �2�kh=F��^bT�%�y� >�7�82��8���+-M5�f�W͋J�H1�>��3���#7�����`��3�kkjq�p�H��!Fmr[@��X�h�K�ߗ��>���)#ǖ�CDD�L1��S W���J���6ykǖ�%A39i�%�)Y�jqi�����M���<�n�b�n:� %u~�K8L~����T�4�H��j��S��=��I�K ��P��o*�;�E�T�<d�9��i3#��@Tp :8��F���3|>�O�0�a��e3�֫i0?�c~k�̢Nr�4oj�ƥ=�Ѵ��h��ʦ)|�&gfTe�����"@����A# Sd��t#�o�� J�3�g�d�������=�&N�TT8ik��q�y�ŖE���Q1�zP��oK��ݍ�i�8m�uF4ʣԅ �Ǹp�+� g.�Ѿ���pCs�un�5�ԧg0�|^�dgu�ُ:�z��'�ؘ��~9��E���E�W�����y�eś ����>·��os$;u�<�V���X�~�܅-�?�bᙏV�G�����v.����2��Z�`���.���Y���Ot����¡y�X�Y=�5�����^���ۍ���:i0�x{�����x�r�ߏ�:q :Sr���( J��`=,�@G(�q ]y�+�A��]|r��I��x���s����bC�}�t�﹜�� /��+̻�J��$y���]�.��0X &�n�MI��G����M��QK���°�����Y�ٳ�;�Uh��R���V;�U��q�� w�ЉR*c$�8 �H��gDp�����#8�dl9�5�;�\�Y�h6H��3�4�m�/7�1�B&[:��V�`���X�8PƷ� j��.��o3�N�Q���d���tH)��`}��.���\���%�Gd�)��"ɫ�A���z���W�&�]��MZ�|֟܍�T��w�j^����S/�h�|��b lK�e��yl��g�'���y6�X����A��qv���_~���|I������-�����mD�d��َ=��(��yQi�<١c+ѕ���!W _w_��\O����칸����d^dQ+VU-2��ɒF�'[��p~�ܻ��l�۞։fd|gu�tq�?��v'�h%�[p���JЀ�v3��V����^���`�>�i����'���]g�kֲ��L:����gyl�ii���#o��t���\6�� �`>2����4'СW�f��T�ay�IT"j�����G&�%抄۩��~{�����J��z����Q�!.�g{��P��������Zy�����Zq��6� UK�>F_�_��g���R���JVU��� ;s��g�͟�~�?��S����=�+�>s�Rz����07"�F��... %���d ���'���_h�$����+X9Ox��?D�Q}~m�}��r@؇��bt��[�Å\;�"��C�������b������h�=- h���>n����$��9��@+��Z��ܡ�p��z�y�� ��߯���O�^=��Q���(/K%K%�Xq�(~���v95��f���,�����$�6�ZR�-|*q�=�zbl��mCcK 6 =���X#;,v��:9�GG�ƑzבX�ա�U�!�X����X��:���k{T-i#��- h>4�vZÀ����8��;�tt��4��d�����H�nh!�tO���;��i6�t�ޘNnE�\��ȩ�?��s�=���/�g���O ;yRlȚ�B���5c��}��=h&��9��rJ��te���OȘzF�$W�-86�Ek��(�x��<�-���gN+T�e@����g��U=�* �r�%�Q���f���8]2)Ԃ&�d&�-�ޟ��-:4� z�zց��ʝ=��ЭY34��qʹ�|����X���F^[�`H��8m�=w�[��m�����Pt��^=v��W��|�FNbYٹ�4N����?`���:OlX���WrŹ�Y���[�I�FU�ȥ��8 �V����٪id?�:�8�j�1�ݡ�d��^l'�]�:���z��YS��o�t�F:W�t��ܲ�W�<�@n,>���w��5��t��з��s2����'�V��T4j� ���؆��)���U\�T�� �KF��x XB�6Z6=59�=~T���P=-���;]��k��Q*�۷߮�c.������tgjdp�ep��q�K�C?V��dGF�p�"!a��H�Ҏf��Qϑ�{�&x�ڸ�|R��v�}��UP{%����3���a�F���D6 ��aTj�������� ����F\��� i���<�8L� �V�pK����xR�/���9�9��z�r�v�C3�`�pN:{����E:���?�.7)(|s�@Є��Sh~("��Z�LpX-� &�m�/u']t]�h�[-�2�����f�`BD���JKI��6B�FWCQ^�Dm6�'3^���̤8��nA>�J+݆z#�b?�m��6�W:W�>�dķz�b�%5�iV+-鶮K��f� j`s�˯A���炟#Dŋ��j�jǛvA�,2�=�{qpP�����?����.�-mI �o�����6����5��M!�����"�e]�����Nw8e�ѹ��185�(j�#�L�@��.�Ɲ��ࡳ�()�mbd�p� eQ���khH��N�5W��>>� �VL���ܚ��O_��J�H�y�n\�}�s���{w?�|�s�ݴ��,y��������r��ny�%�X�?��9+)��;\��C�`ը9+U��������t��f3��<$�/�XA�@8E�V��RYS���(ז?° ��u'c�c/;c/�s=H����-!�P#�k��t�A�\�oG��7��>�R7�`�ޟ�� mO��e�x�)�R-@M59�z���<�i��� �-/�հ��B-�@^%h�( �FHm��-7*+�`[�Pk�`reH���l�[�`�<�t2�[]�4��!J9�O�F��h�{�V���6�n%��+֜�Ċ{�����QO�"�zZ��Cŏt���rvC]q8�y�#���&���^{;\�xBy�����ݍJ$�����w�0P|YxU|YzC~3"]dm�^b�g�a��u���^�g����B�W-/�IX�hEZT�?�xɰT��CQU�E�H����H�SE8[Tk#O����6�I��*��Ī������RAeh�.� �K��LV��p���YO��k��`j�!��߳��]@�D�b1���κ����Q��� ����͆fB� �GY�]X�Ĥ7��Էom H�\ ���@�/��G��'�n�C7��(������מ�ݲ�����7��lּ_<��}࣯�Lz~�S����81�9��K��]\��|[�)��|[��v^ �0���VpEBmሪj�7���YA�&b����bׄ�S=)���I�ȕ���������+��K��?����gb[i�8/u. s�|Wis=3|�ږyV��x�?mS�ǘ�b��y �}1�Sjѽ�i�ӆk�a�|`y �l]�Z PM���b��Ů.,v-��&Fb*"�f�o�-]��� �W��t�Og�`��(� 0Z(�������(����(3���u�&P�h�%�����ϻy�7V��,��VΝ�����WKߚ7k�-�r_~�<�5�Ъ�[�o�zN����s���Z !@,M��m�/�F��I�E�>6�1�p�������T hg�$3�c���,�iˬX)�Ra��\����[���iFp#l��9�7���$�N}b������9"V/q/��� ��F]E<���T���zIT���F5�jX����j��$�$Q#5�k�uB��b�� pb�#�dzGw�s�N{^�������8NźN�\cjC;^w�Ι���ɬ:'�8�npw#�� ��{��:Õ��p|QQ�D0�{��%cm��ꩌ�$�� 8��J�gR����ބ�sb���6��/^�5W��>��:}�ӹMe�wΣ8A�ø� ��Ӻ�ͺ��J f�X(uDt?���:t�� � "� J����b�%����:�lڍ0���6/��ը�qQfq�|4b�c$@�3� ��r��C� D�s� � S�V-+ZS�������� ˊ;`� qJ/��e(�Fs�^�����ᱻ=v� �Fwӊ������*�����R(��;i��S�k���{4^��J��J�� T�b���9�� y���w��� .g�K��B(��N�]%����SAL��&�~�6��@���9��H`�&��}�[Z���tm�sw��:_}۽�X^|���w�fm͝��xx��z��sK��N��{���5 �'<�lh�n�g�<��W@di��"�W��EGhÌf��#!��H���⩄���5�f0;��B���n��Q� j�Qo�j��3c�[xL굉��D_���4n��\����-���?�e��9W�T�_������R��k��l� nz���7`��S�X�`��%�%">��#]/����E+����%��b�4�k=�����,�KF�A���'��9�|#�? ���-��n��x�� _g�Y���G�?����4c��m���n ����Kg�P����� d��S����k���H�V�3ҨW2q�^ ���z��~t���o�� ����|�&fqW�懮L\�1�6tg�a�s����}��N�����m�q*f���Jr$9�����h�T*�zK��*�dv+�D�)�Ŧ��x��A��n mf��b�םg��*L����$c�$S}I�Ē����s�N�\�~Ô_*� ��-�]�Q�V�m�ن��k�ĞGjk�DQX"0 \N�ʥ0d�� ��-�����8�/����]����=7\�?O�x�����۟[~�&<^���7�y�50q��|k����>�Enǯ^�jٵ�ѵ[�R)� b��O�XX=� H�"��\y��#B��Mr!Z�D� B���������o��������O?�?��}��K��u�=\3�����Dx�L�������<t�^�/�x��:�^+]:�5o����@H3nN�,���{po��q��،ޑۗ���t �&~/���� "�%%9�䈔�y1 ��� ��*����2�'8�F���ƣ�� 3G��T)����s��?��͝�lF?~�fr���C�c�� :�O,O,��:�䘀������A�g��Z��<]���y�m�"7m��u;r��SO�� ����� ha�<��N�AY�V�t"[�GA���xI��X-�+)����Qty�j�r��R��8bs����C��:��d�u��:����fq��F?){�1{yj�ډD�G}�K_���u�����1�|뤾!Ҷ�)u�9``��+�ٰ�!��C_?����Q7^�{8��;�ҕ��Q���-<�Z0|~0�%�����hEްk �4]i�S��������ϰ^ez��� l���֪ʮ�J�ή�h����И��}k����>��m�PO�q�Y�℞Z/�Jy�Ҩ���io ����1�" x"�Ͷ�h�����O��[yo�,�"�<�Z�(IV�e�*a��;X\%&Y=��p��۸o��YJT�ȉmd�� ���N0!{�al�]��)q�����<���|ƺe��]:l��Y���k�Dn��%"�����n�`�PP��@���PG�Q�>4���f�9�d��J۷Ͼo�*�XW o���;yR+��diO�W?P�m� ��?��]��� .ι�\�L�8R�G2��:�������D��='�⽹�d2^�������A���r�"T�oߍx� �������Y�E�m�8't��@Yd�U��"��.PV�)���eS3C<� g��VVVT�HQZ�8u"�p��0��t���D+uz���\OR�-���Eڏ�Lk%2�=���K��Ւ�Ւ�jnz�d��W���Vʁe� �Pԇ�e*0�ң�1�̱B��3Q�ԝle f��SY�.�8%����uR�j[i����L�~�$,u�zI;3Խ6�k��vƻ��v���>F�%���c� ��Ij�ۋf]y�=�6�fm����/>���s��/O... �C�1c\��?ۏ:S�)G�z����:���BC�4�!;��R��@�^��8�m�>>�i�#�ْ��s��� ��A:�x� {�^�X�/���ŕ����O�(J��xi=0�Q;�� Ʃ�d��g�&��R>�裖��-Q��bGGٓ2^"b��tx5�6Y�\�ˊX��&+bMV���Xe��2�N ��_v� �Բ' m��ƠF3,���u#֘��1p�`>��"�'ZSZқ*N�I>�HlEq�s��p���`�DH�q�l�qBU�qT�A��=������R�����M:��_:�����l�����F����n�snC�<�/0�/�5~Ůkn��x�U��{ӱ�H������E����/j��헽4�{�����~h��;i_>�P|i�VZk�}no �Eu�zP%�@�Ey2�L6�L�]�0��I�HC�LK�~����" IW2m����6۰�XX�YX�YX�Yb�Q�v]�*��.��f� f��l8fck�-���lS��T��[eÙlO$���P>�9��k�����2��P��s$��Uh��r.у�=�J"���T0b�Ú ���ɬ[�>.�J�}������ځ���m;�����vT����ey��L$�eQ�XB�8]�M�� 넭�X������=��Ơ��\1ظq����(4�7fsk67Lfβ�~�����2i{3جن��u�]6!
�2�f~h{��5������1;�3]�I��k�ն�NQa��j��цC�|ԡ(&�)&�)]���T��Ys�̔�F\�Y����8��IA��>�C�l̍cn�=�����8� ��45��L��e6E��m:�eX��m�&:���y6�}k�<4��UZ0����5�������Zt���`�[s?�r ��0��%q�Q��_FV���b_u�z)�������q�b�X��p���_#<�- *�k�x:r~DW\�.F 0lvX3.�u�˅%O�Elپ���?�� �=��se%<HQY8�� �G` _GTU$��HV9b�� ���Qhڅ#/\,�m�^����"qRY�G ����M-g��:A�3�Ag���S(��Q)���?@x� ѡFX��$kur�=�{���P����@"]9��ꤍx |Zg��ٝ5�f�jJ��2n�p���x�S)�Ƭ fx�+ g@�>��җi[[\�ē�uO����$��L7���^7-̦���8�8�?ɹ�5�g,u>Dnɣ���*ȇ��:� ���_�%�xI@��VL�$ǨSI���1`�c]��.��k���O 6�� �ϳ��Fm j]@��h��-�~"$:�~�r�*@Xis� � �e��ɴ?��/���Ew +� Ld�bG�BT��d_+��]L�5DG� ����l�[�J��91�������4$�N]�̴�b���J��<+VR0��"�(��Z+�3q����� z1-�5��j���v �eL���#�E^&� id�n+X��!��g9��8�������vCg�g��͈8d ���J��)�Y/rp|�Ve��]�/�-����"�[_�h2�,��H�v�A��^Z/o枕Dq���8Ad���K�����㰎 �eE����5�O��fq�!�� ��.��6�YQY���1�z�[��۱�"m�p`d����b� (�X�a��L|)&4 �h:�y���A� �� t2��X u[=�E��i�\�7�u��ɪY���g$�... U�A��J���x5��6�Bknr{6�}�^�ս�}H����c������Ɲ�Ǔ��w�������gFt��9��:�Gg:�y�pm��2�2o�F�?`x�.�I�ʷ���S̳r�t.���B9���O.�b! ���5��5��5���7R��b���>Bl2��ЬfؐyK�I�@���N���%�⾑W���m���j|��dz#zߖ�C�cw��5��\g�^{�[�6����[�x؋����SSR$��%�_L�oO�'!V =���@��? 5B�(�&$&��n��rk�����S��}���3����@("�Q�0P��}����S|�W���eR.� )���(OrN�N�L.�X|i�Ғ9�,�� ��#w���k*h `�����3��� g��'P) x���9�<� H�s�@� J�QG�Ҩ���n��� 8�R��,�):n��pS���6E�������P����T�/�/�/�S�&8�st��X�g�܌,Xͦذ�d!��� g����f��D �jjZ����T��-bA� ��-H���X�T��U 3�?�������ڂ��I%����7��ܧ8���S.��X6�*s�e�xʡ���=��=}hg��]=����v��"�a���l`���&�m[@��|���bǮ���ų��ż�RXeVJ�,��%mR�1�m��Mo� @?�� ���؎��']/*�� KGa ����(e����/"i�8rql�eJd~d��Ծ�q�����9G��K� l����q:N�Uq�I<�SE�'���Q?s��Hl����x ��0�]��L5�*��GS�GE3�\4a��djXtFdc�X���R��$��(��(��(��"�������~{,�u�h�ǥ�VX�q��LO�j�� ]��>T=��/U��6��@&nb���n(�q�fv�ϮG2�YZI1��TmC�A���Np��2���D��{����Y>aD��k���G|����z��\/a���/{�d�ksM��mk�[��k��~ˆ�f��S�_���E���v��BnD�L�H�qRJX>L��!V���,�IXL"bl¹g��+1+�s��E�b�O��r�� �"iDѐ���C��s Ҕ�K��p��yh��D�$R&Qf �����4��I�Q&J�r[���reɾ����䐞�c�WY����gyf�Y��]�Q��tQr%��r�m��.���[����;�{���G<� �BJ�����>�Sh&���Dz�aN�l=�eI�|�Hc�7�C�F}3ҀgY#�KY6�߳�����R��"�#EѰ,�у"�/��"��J�[VdX�g�NJ $ ����g��,�3F�_c���0�N\�Y�[>�p�� �|j��is�[N�(�z�{�z �����56K������|o�Iܹ"~M.,ضl9�O��Zp(�@��[�b�D�¡]ғ�@� �����F�a b/0�� �d��ƒ�T��I(^�RZV����?�r�Rge!o�%�A�L` �,`"��x���~gu5� �I���:��TKM�є*��U�5>Sua�D�!=K��^b]e}�����~5v�k=Kk�}��Ԋk*HE����~�}�=o6طڿ�s���,��0��ks��q=NgP�Y��]�����y;�(����F��m?��=���������}"��b�6�{���NӹP��gp���RW0G�1�H�<��R:(L'P�ƌ��R��ի���6r�n/��\�X�WjkJ�Ps�jN0S>0����N�ΰ�S4Q�+Ӟ!38C�(����,e͟ ��dz�'��=���,}U<... �5���.l��U�Sw��:�;5t�,^Kh6�3�(�� �p�g���k�wk���;:c/^����7,ݴ�܀�5c�'��C�띷~���w�Q�44R�� ���/F/��e��2�2��'\�̴�^�- �����(U�e��#��D����9�52t~d�kJp\d�k~hZd���{��hȇ6���ѷ���"�u�F�h���C��Rb"{�κJ��� ��7FY~�*f��u�G� ���6mf2��^J)��i�a[��f$S5t�5��q���)lvU����N�Z���V֘}mH���n�a�n`E��8�Ӣ�~��ɦYd�(l8�b#����c�O]gS]aZL!K��F��`��x�8˺��3n���T}����w�������R�~������Xk��w,O�?ي�A�Zqy�����=���+�~��7�C��.�� =�Q�#�3�+��>j{�&�l嶖`{��f�C�5E���:"*�����s"R7x�'�fm���B�0kL��01yđ�0�ѻ MG�k�!ԩ�uH/�C9�8�PyFU�X����������y���^�v�K�*2܋��8:�UH�Ot8��N���tG��$�،���ȇ�hNQ�D�^Mq��St�q�+W��i�Dž��Dm5���8Ma�K'�n߰��uɈ)��}� >p�{xmӼ����S�6^���,�� rc��A��No�XO�%�a���`Q�%�Jd,}=[�z&J�,�-'�y��$���K�W6�l]��*�o�oE}�P�����K�T̑�ǧW4V5W*�2�m�2��'z�ȶ��[b�X��^L7�vt�'Cn�5!q�CJ"V��NVw���L��2 I�X���F����.!����������c�X����]��0��o$�0�)�'�ٌs;p�3f*f�T̘���U��aG��;����0�eð��d����(�wwD蝍��͎`�jq��sz�1m*��� ��� :��haf�Q�GM���4���e��;���Z3)�� �gm������;^��cW���?3�/��C�ܸ|��n���3cr��;q��b�����s8����������K�vB}c�߿�@������x%�Zn��ƳM^��/;�N'`��ǢZM�k5��Mߨ��hM*zuߚ����c ק���rVzh�*ԃu�4yf�+!z�ad�xhG�x����G-����.�,4�G���oM�,�m����>�G<��=�K=��=I#{B�Z�oN��A<�-����� -x3��[�I�@��an�(�1��[S�̠mJ?��y%�����i�h��v��6��(M� Sm�>�יp����U�7�/����k獹������>�h�T�i� �ᄆ�e@��йu4�I�Y=HT#y��t1��=mN�� �g v��Y)�Rb%��i�ҝ�ĶNsb[�1a�0G�c��J���� �Բ)��<��������S6*-J�rX9�HH)V(�ʆ¦#J^Q���%�p�H�M��7a$ "��RR@�~#�·�Gx��?��������G� �ϳ��Uz�) �T��f�T)+��3��:����1���Q�م�G ��� ��߫[[[�8p�˧N�R �����]_�ř��3�i����{3�ϼS�|�3(ĉ�d�s��)�9Ŝ�e��&���vb����T�cn�{l���F�&,]�g��`���/�S��BR�NR��Uq�gD�SRRΈ��z�h[� N���e�C����ģ�Wҿ���^�� ��Z�Ȱ��r�H��x>i$٪��< n�(�7� �o�]x ,��ڐ��4#�fs�|Z��Id� �H�F���z4D��A�f���%����8��$... n��`x���3��n�p�Y�p'~< dž���0\�~|�8\�0\��џ������pnS�����2'�W=5�٫ν�� ��9��̒�/<�xѶ��5cǮ�?�d�ԝ#t��ڿ����~�CjQ���:��}������| ?������Y���� q2��C�R�N�rI̍ݤ䬗�����#]�����L����FC�歌r ��sA��Z��B:��6Y�|� ��\egs|� � ��3����O�7����ϻ����{�|jSӅ�-V߸��=�s}�Kn�L/4��5�� +�M.-3��I$M��$&Qbq���G��E#J<%�����Kf�,W�Vn+}��B�k�M��^ë>� a2��VS�)�u�e�u�m�r��8�C�A���CO�eQ��QR���tc��`��d�x��sн��{�eH���E0J+�B;#�����ޓ�_i&jW��"%�fMXI�T�U*C��ʚ�>�}H}��>�*EÄe�3�0&aOĸ���-Ƹ0V�`(�`uw�X���,)Z��X���-9J���`�¸M�id��X�;�2�U��&:z�����c�i�Z�&��B�6�J]/[���^�#����o|e��źh��>_��m�>0q��7����p��s�d��V����8}� W�M�/)r����/�2yå/Rl-�O*����7���w�u�q�̷e�h*{1@�F����@41�V��9�Ӕ�C��YZ *���Ԙj�1+�K�eH��@j��I<�g��"�K%�M�*��:Θ����� â/�9_'�Q���Z�+XW��(�!sQ��6�G�=�_F����:6��YG����Z{��4����M�~� �ڃD ���⪪�n۱s�;]ݴA;o�d�Z,]��km�/FV�h����/{���(D�C��s��D�cz��I�q���Y��g��C�>��Ƈ���%~�h���g����y����Ly��<��0�S�3��oL�&��q��G�hǖQ�%t,D�6�ZB�O�M��J��08ѥH�{�c�A��+�"U�ia\Be��L*�kQ� �2*xV����{b(U�T�)�V�9�kv��FD��<���0���0�Je� 0U����}Y��*�� \���/r�fi�8�;���^8t�"r_玻z;���$s��h���@������j9�Ќ~��L|� �qS���L��-k�/�H�E,v�-��Y�=�ݳ�Y��K�F%ΌJU�͙Q�ﭑiA�;`� K�Fg�h��C��L�$Y�|P��!���sjP ���+)5�j� �0u"�H�I�,<�̑�(K�u�:�L^�\��«�J�i��Fy =�ܫ���P_A/I��7���C�}��w�:�V���S�QJ���F����W#@�Ԙ�ԧ9�"��(�:؋�� �-�6f��Va[� X-4��4� �����QϮ��~�$�IE�(�����ޙ�WQ����3sg����n d�^ ��Av$�K kT��AP.��A��WbUEm�����A_B@ �`]���֝*Z�Z�E�����33��R۾����n�;�9gΙ9s��,3Wh|������?*!��>�J��,]I�d��qo����T�����ޘ�+��>��嗹9G�������)��2[�C�}s��mpvB��%�����H/E���ٿ�_�.���+�⣷\2g�|q��j�y�FI {��m����?�HX�nϴ����Dr���0A����gP����)r؝/���� �x�[��������2bυ 3f���R������"F�ߟa��R�����imNH(FX3��...
�k!+�~�6��M`����.h;<����|o����<G\������r}.���_"?�c��読���?�!�1l0$3;��6]{��vF�fT�f��[w�� ]�v�u�$���7'#��O���8]T�%�c���~,v%�k9���[BVy�����ޗ]�+����3�ܶr�'�28�]�F��!3>�_�>(]��a�{u���#a��;M�����f̈́,��K���kR9�����.B�1~C����/� �ׁoZ�����.����� O�vK��vh��fn�T}��B��j�l��4ޤ�)��u֗u�|��2��F]bח��t;o��s�jLi��֦���Ǫ����O������R����17ݿ��Tko���͞寶tڮ'�����MZ&M���Mh��˃��l�@|�P�[���9[��k�����d�r�^���P_�8�O��̙������ΐ�m'�z;r[�*��(`�`& ��{��k� �z�������)�ez���09�Vv��9c���E��7��Tw�~ �T�[L���.{�@�u�_b4��U���+����ƍƳֻ�����h�5�^l����TO��멢q|��A����j�`#��9}:��?Z$�dۣ�a뗶;�Dž��#&[�S-�{�Qks��_�T�E�Е����-���+tr��� ��Km�S;�?D���B�լ�K�I4�lu���>��:��hL�\'ч1è�1~�:p"h�ӭ�6�>�c�1Ga�u<&B��5d ����s�Mi������ۃ.�+d�� >'��x���U�Z��Q�ʣ�bfh�G����P���e�F_Y�xnt�M��X'f(�N��kn�R�ItІ/��k%ϑb��������|�Jh�J�{ԩN���An<_�N0��}˵Ų��T]�e�G��u�F(v���x�Rq�/_���Zƿ���R E�a���h�˱,.层O\q�YNUzVq����}�xW��a�������xUCq��>�l���/C����x��1/[���m?������e�=�~3_�e����~�>U�Gȩ��F=�h3�x2?�'ֹ�g~|�G��|��\�����D �ː��hX.g��g�j�f|�> �cz�>�j�ј��?��^��"5B���6���+�إ��ƳE�f+���(W������+���k�q��X���9.0r���k�e�ˇ}�5�Q��Q�د�_a���PYo��'s�����o���ݬ�o�����*�~�}��� ~d���)���X'�\��b��{!�U��_�}׃���T(�m#טz(���˲]!�$w����߄=~����W�?��(�������~b��Y�]���� ���1B_��}Ȑ}�r�� �S��1�F��P5LJ���U���+��!t�E)���)��l�&��^����P�S!ώ|�+� y,p5���Vg*ߑ�2�&C�Xm�Z�xJ;�+���kCQO�N�_oϷZ�&�{Vݯ�r��X��/�������.�m�M��:�&��mϫ��9���+�X��^��l٦b/ ; 7B1�����Mn��M�|�h�-!�s�⽡��w�x_���\(�MW[�F�� ���k�z���ָ���8�w`{0�w�X &C1&Цk�)�f"�ss:�1�_�,R]�`��}=t��Si�{. {��0��!�W���1Gs�ڃ}C��k��{�uezD�,~ ;�q�2s��>_����q�>ڞ�:S4n,�n(�����?�����$g?W�ϱ,yl��X�0G{�=�� ��Xp\��X� x�*y�k��xP&/w�E<������9�i��2(�;�� ��d(�U�����.B�<&�$#�G�GL{��2���XI藍?���̲-���xX��ˇ���gem��� �����u���q`��v��9.�="���C�>���W��+C�+���k���)f��**;E׳�Δ�;I���|��,l�c����ω��)�s�>v��pl��Hxޤ:X���[�1�D�� �olR9�5�_���QY�'����g��c~?����cA/��a�>�\;�O��kD��oʾ2�M�?������R����Xz��9�_srD]���1`��2L������R��M>#�c�ǀ�lj��g�S(���Atq=I����G����:=g��>�{;Ԏ��3s�X+i���a��3�b���5K�l:���Dk{����phKi�u�]�]��g��=7��r��Mþq\z���W�%��Xc�/8;����s�Ǚ���Y �Q�>��f���6�e������� 빗��#������r�:������x��r-���xea����K�S��[Xca����������84�9���`��S��-�YWٷ���U�-���#���}���@<�7�5������m �q���l�r�a�����ڏ��!�W�}���}4���;���f+��b%,O�r ���:�zkCS��4��8�a�iY��b����}����=�7F��9X|=���?���OE{�z��A�'��s�犟g��LR��k���~�m ���c��� ��}�wܯ�P�9A�K��Ɛ�i�>;�h�{(>����Ex-�~ ���+�u!����x1��m�W�==�4 ��wh�o�5�h� ��� sk��/�{X>��v�cco`�9��O�K����:�ه-�˼��(i~�÷�u���F����WBq=��!瞣�����X��G�;^S1�|��?3��a�C��r ���b<�+tBю¦���\]�M����&�v� �����n�����1�<����P�]�r����m�ñ��1�/�n�>��!|��n�E���W��{�=Z��!�3��<� c���#����D���6�s����~�ˢ|�Ѭ����8�}� ���=F�`����� �_ �>�~��� ��l��s^3�|T�-�j�b]���A~���/��C^��+�m/�d0^��5E�>ȱP>'�2k[��4�jӵOq&|p,��oȚ�"����s�8�ң�e2�X@.,W�Ǽ��@Oۡ��5z�p.���a�l��,O;� r�s���8+�����^��2?����}5��^M�pr�{����xm��.��<�'yp�ُ't`{ԥ��3�����箣��J��cn�>k����ڌ��m�3��áhS �9�;� �״\��Gg����=������ޏ�}��_���c+ �1�=ۦA1�ssܖ� ��]�9>N4�o j��%��=(���h�P� �Ux��u��������w0������P�]��C��'��e��ޡ��~ߊ:ȫ�z,'��F�A��k���3�l�m��Z��*ݳ��c�|�e_z��l���b>}�UG��-F|sܚc~�粸絠��dYp�zI>���FX�ۿzI��;l���4j%m�����+���%��5���J(����~���U*�p�7)��bl+�{uz>� ��u��l ����mb����c{�{ ����쇡.�q�s... K)�9&����4j�����k.����էXk�kc]Ʈq{܃dK镂C��� �)�t���e�]־g�������5�^�.�B�F��b*�_cv��_Q?�.%۲�vl���}��MC������t��Km��F��_� 3� ����R�����}x������w��W"���e]� j�6mAݮ+K�� � �Vv��ԞT��̿U�ם������X�������_�8G��~��u;Ɣ��TL���v��|����#K�U�zL��ޥ��%}�i �~T�.���T�,��醕A�+��ڈ~��c������zL�>�风��2g��?�2��c�j� ��v�e6d��ߟ��a6 ��Q+S�vno?6��1E�qⷁ�f��ܞ�i6g���h�o��� 1N$�y6>+�6*� �K������%�T�c\��wg��Y/�e|����4+ee�[$�ׂ�ž/X?�L�&�Y�;��1�A鰥ȫ��OC?�z*���dۨ?e�jQ?��<�6����g@|��/�, �� K�GПr��i�� 5��<�/=L�#� d�rC�e�wu�>����/�\��-�/���?���6�+P��� \����G�f��OO�W�=��)��;l��i�ݓD�h�����j�i��=~?N@U�o�5Mq���uu�k9���VY�Ŏ�t�蹕9�2| ~�����ޗ]�+ӗO?s���QCFx��O�~�̇�� Bf��xf��W���_c�@?�#��_,d�;�g��v�y����y�,=g5nk�q�������T�Q����/��e��Clc��S�-~��d�����,��K%��1�n%��'z~�����T����w��.s�����hI�N���/��9>��)/��KB�Y���^O�B���t��T_S�X��6���}�����+�}��o0�K����iN��&�~���Y���wu��M��s��Y}-���#��������X���^u��֩�^?W��6�ϧ���[_E���(��l1~����f�[4Z��_����7X{�G�Jq�d�h��.��b�Ϗ�~,X��Vf���m�z�6�V~69(�W ^���g���t��q�����w���Z+�m��G|V���9{>�[��su���5�\�� �b�d���V��@�S�1�7�=[����ʗ 4~U��;y�z�)��_>������}�_��I;����~��>' �A�6^m>� ������Q8���u��x,�<.ّ�kF{�U�+?� P}��hW�:��8�۱���9������w���������u,��L��/����鼻%��wY� �ҹ;��H[���'�����'�������/ث%��dF��L�X���%�Kq~t��\�'�/��]���>����,��t����E׃����F;��kO�8�=B��B���������'œ��=�4.ד�����+e���� ���йJ��`\��OCٛ�$<�>����M��q��y�� ��gM�ޒ���z6�b�^+��Y�Q���o��}����b#���{����흂����4Z߽+>od�)�S��=��D��L�[p������������{���F�1;7�>kC��I��x&k2�-)�gx�!�wE97D���q~�sw�3w�\]:W��եsu�\]:W��եsu�\]:W��եsu�\�hH��ҹ�t�.��K��ҹ�t�.���2�su?Z���ҹ�,����Apeҹ�t�.��K��ҹ�t�.��ӽ��[xT�~L��bC5>y������e��1��hZ �?���������^MR�ii#����1��z��~K���c������Q�]�ux$�iJ~;�� ��)�����1;��\J���"W�S����JүG�ꂪ�� �Z/�����G%���͟�v�(�ڕ�)� �o#�ͣ�,����,�ϣٜ�sR�e��[[败|]�Sٷ#�<��|�(�c�DY>��)eI^]ƫ*�}Y}��P��k��Ge�]�]I?!y�X;�k_�]�n����~4�є�z<��h�{=����ñ_M��D��#Q�&��H[���>j}Ph>,��,t��̴J��=�����u���+eޝ���b�i6{��S��<�h|_���$��ח9Iu.�su8W���鿉|���d����ǟ���Ld������H�oH�'�lٙR���թ-K��ҹ�5��B�;_�5��O�����!�����3�ϟ��[����]�����sCq����J���m+�����ʽ(��@��� :/�}�A{������W�|���>?beζ2���M���E��Z����t�w����3���C�?��T?H}^|-�kSm"�(�}9|:0e�t\O�<�^���wx�B��jW�=����U���&�'^�Y �wcς��]��c��ߖ��H/Py|�4�{��`χ�c�ঐ1�����{Z(�;����Y�|)h��A��������ϧ:�... �i��pڭ�)r� h '���f#-p��u�"a�:9L��'a`|E��x�OB�仓�j��h��TF<&:5�fM���,�FC]H�����0�9S�RxJT����,���eu�����m���*��?�ϸ�2_�Hcg��1)� ���q���u���ٹ�yϜ��Ni�x�g*隷�ȝr՝���6���m�����0���ڞ�i���x��;k&�vu�ϟ�=ꥭ[wM��=-0�T;��q�k��M6���6}ֆ<�ڶE{"to����$�5� �W�B����Kߕ�r�+a� ���sxx�ȶq��v9q�ȸ�q�81���%�H�+�a��e�<�͐�+19���&Q��3G�]�4=�O�m%uGFD��`��㢣���:�M��ݱ��RXf\ʐ���~\���7�W�G�X��9��v� �P�_ul�m�Oc�:v} K�kww�ͷ��G�'ن��Q���T�7!7EC�� ��('�7P�����KBFt!�7AO]Hh-H�O'Q�����>ce�n�R�h4B4��`��43�)=}fzzf�{;�Ʀ3M�]�Ni=m�#�����ٽb��\,z?�콾��;z�4��1�7��E� GwRnuM^c�2~��UL���{��e� �͂C� �ϵ�qN�wg�RYW�isFU� �U�o�q�Q<6:>*"&�l1�l<6�ن�kc��m�D��,*2��,^D��j�H�H�� �ob-�*�ζ̨qQ<�������4;�j��y�Љ����Ą[v�i䟳yW�5{zlމ����=?/쌼& ?}�#����Kccz���իGv�#�����sa�������sˬ�����|�-��մ��/��E[����~F$���v;V��07�(]~Th�;�,�/ �4� �6Ds�T�,�A����%�����Uh, ���5�[Ҙ*7$�c��h�����4D�+��h��<�';03=�2�~���g�]L��>u��v�} �*��*�Z�i��n�I�m�jU�U�cͱ[�#��i��vQ��p=�MF���œ��1g1�$مT�:欴��y��;;����m��"�Yoxx�\p`� c߅���S�3!��M�Ա��$d�� �阰Z�IJJT��J]�CoR�0'�y�Z�����>�f��sڲ��><���o�ܻl���P���,���wb.��.=�����{��� ��1?ǩ/�/5��%�� ۨ�Q����}��������o�!�þоп �=a}��E���0m�u��تDal��m�Ū��>����d��B�I�~!LČ��!>&�3c,�^Q�;d�mJ���iv���@'���D�[K��Rc�R�UF��U7�����^��>���̹���|�V�˙^�{���}/,6�lز�f��-b�9�/�*����� 6 � ��7�ʈ�HKbٕ�8J���e �<�ٕK�%�^Ϙ;�j< J%HC���E�c��mB%�i�����&�ߵ�В����o����㥥�K9 } �/ǜ�Z�����\�o�3>��w��3ߙ����z{��fnC��~���#�"�~�&Z��{�'y�V���~�N�<�d#kG� �|����Td��'Oγ���� ���$���V�W^�*uE,��B{�F�/��])�����F���g����M(? ���Ҁ1��&��y؊:Ɖz$������������(zy�}h�HG[�Q� �HD�J�^�� QVR�?��D~7���F�eY�F7!=��'dMC���Y�1����Aȿt$�S^� "xd_E��0�g>�WÀe���������\!�a@�J�e�����@�Ef�I��h��2�#�|-�D���Z��ga+=���>���*ĸ�D��ό��yGЯ���N��V2�B�|m'�A<ȓ�EL]Oӕ���4O_M�"�xw�'J��P��J��r�50u� �a����ԡ~FI���m�'16�ļ���i�"0���i�5�L!��c�y�����e�N��tH���y�9�����l�?~ �:��S�~�9!CR�LȺ��·�Ac�$��J�P �e�~(ʇJ}����!tC{Y��p!��r-,3�̍�$���t���(+�g��Y�^u �:�R���z���Щ���� d�Э���*�'ezX9,��F�[��q�&֣X&-k��n����Rס��fz�F���U�ӣ4X}�+��ڭ���������a��i����`.��wm]#`9̮C[���0��9��y�0Ӵm�W�W�m|� �C���y� ������ ���6�����a�@�k�r�e�E�Xt���5��Y�e$�t��t�M}57����Ƒ㔊�����D�/�����{K���`�� ������s���} �Bg���@���{��M���8�B� �>��6X��W�X�~�J�A� �g��v �OK�^S���.��Sȱ"�a��6R�9������v�U��4�\�]�, u�3��^��8�5�����גo�U^3��k�͖�W���z��K���eb=�R1Nb_ �ZM1��ò,ڗ��(iH���:��z�"�U���XwOԷH�B7��J�����i����\���.��(+e�0�8�U� �tE�<2W^�d�'�<������w��R��VK�b�D?xO�51�X�Iօ����I��}|Y�uR�o�qR��ҏ4�e��i��j9 r��:��u��H��#(��n�����N�O?R��D�UKW[�r�U�_��q:6��h��J��n��H_.��G��QZ���D���.�G9JqBGпҟ8 �f��h���;���0��(�r=�Fx���8��%��D�H*��O��Cb�X�nq�}�2H��*�A��i lI��(=�;) ۣp������|`�2��,u�.��dzRp"�����ko(OP�:��״�g���`��1� �.�j7��R���ܭ�R�,�}�K*S+��@�T/MR �����G�i�4Z�?�Z�c��O����4��r��_�x�Vʖ|- e @ȼ����Ww@����W��,�)������O��`�>R��7���m@ ~x�g��=�A�2��gK�2@U��� Я���z`�jO� u?Z'��O�]��x�(��������e\˦>�lz���d� ���;�e�P�R��A],V��?F�(�ŵ���:e��r)�.|�Z���e��O���)(�W�؟���`~���_C�I�>��x���kY�q�\��)I��� �җ�������c��p�@ <�����i-Ѓ,��P?By... wճС�=���y�K�tD��wzi����M/�X�Ɣ�2vOR=|I=����Iw%{���Iw�H�M�%�����s������� (>�O���~�col�Y]:�ܳ�]�'[�v��;�;�)��#yxI�n!HE�n��G� �jUq�}*�A�#P�: �b�Br�b�'����_.
�(�"ʅ�S�,�.˩L��=�,)�u:e�T�#�̑TjQ��ڴ4Y��d�+w9�`]dE�d8d�NV�`�1O�"�f���Ezʶv���_&�s�Llg�I�7?� �Y]�9�_(��*�t�L*=��N�{Np:k��N��V9a�TA�O��qM.��w;k��p��DvwWq-�P2�����boww���⊺����Z��Vy�y*������ Γ] ��E[���V�;_�U2M�}Yy�� +����:�&:\��RQo��/zw����=*�-�&���*�"+� �@da���$G�Y���R���-f� �Q�B -�B���CK=)�G� U�ǟ�f��̶Sɴb���l |[��Y���>�gΜ9��Ϝ�YD����K=��B�MUW ��@��ȴڐ��z�����͉P:K��Cq������Qav]R����b_��o�f��3���C�8�̮���8� �MJ�F u�`4�O�Q�L]��2�&�&�&WG��Htl[�7s�B��g��l�%�{�۶�l�F��+�g19^�6 z���2k�%����,�̄��9�9&�̜#����c�?g>��O"�� endstream endobj 202 0 obj << /Type /Font /Subtype /CIDFontType2 /BaseFont /MUFUZY+Arial-BoldMT /CIDSystemInfo << /Registry (Adobe) /Ordering (UCS) /Supplement 0... �?&��h�%���B�u��g����i�a-Ǎa6v��`L�_Xn�b��n=�9Z91N0�s��L��HHX��ȭWs���[F��[1�$u�e� ,9m ,Lt5f��\�Bw+���q���5���8T[H�kX����F��(x�tvjqH{�IE-�Īc��MVn��_���� ���e)��bT����C�$hX��DL�Ix������kc��3���`'�S_Ǹ���B�,z�%���E^��r�W�V�Qj����ؘ,F�þ�B�=h��#("Տ�� _ ������V���&�Q*�`��e��O������� fx��� ��t��ct7�.k"�Gi�m�2��놇�v�QB6�댈�0�@{� �����ȇ�a�� �v f ��^�����L�/$G��*(,�*M�K�9�����s4o8�pC��q���6w�O��^��Es�\��k~�j����s�H�\����oii�����bp�L18���h�gɴRw�� f�LKm���;-�҆�Դ�e�,�Gb8�J6�ɜl2�edP�q�Hq�Wqby��v�Ls�'��g3F�SdCf�M� ��H���S�ۘ�p����S��+�}�?��R����u/��{�� �..�<aG��uc� �-E7�|x�j%���.|�8D��J���p�Ag��h�v��q��[j���W/�3�I������h�̅5�k���ƽyu'���6P"�yb�q�L?(�Q#�K���ݜM� g��2�,��!n�p�rj(�$��-L���\�Hg�j��CGy?�yֽ�����tK@�)P��O�d4� ]��EC�� ��D�/ ������27KgC�]ׯ��S�`�N(�Gc�����+�C�Ĩ���X�BO��'�� &�~+H/)�\ۘ��f[�l�̎���y��=>7�wpυ�}x ��e���Z� ���$��^��X�U����YW�Ł�'�|�����yt�)�&y���( �c���n����t%]!9bKvF~����+8)t��M'�]]��j�����w��h�>�]�(�M*_6�� �͆��JoPexL�y�l�C&k�0h�(��v]��8�uf���a2)'�8�6qb �9��/�Y��v�2�Լ��*��=�����-X��&�Ɲ�ZR�䎒�o�f.�����Y���V:s�?��u䞹E�W��,紆9Β͏�__ ���ð�TrQ�gbr��IL���ۣ �� ��t�M���]�ǁY��W���-�ˠ����Ҳ�R��p�=�d��߶�u��_�j,���w�Y�������ssW�W�O����h�n(�w�ȁ���?wZ���`ފ��m��[�T���8����\���q쌗����l�,s_���u�]�_�y�����r�Y� K��6�� �s��/?��n�_ח��*�u%$5�rX Q��(3 �F�{��eR8`��v�0�kR�y���7>}�;/�d�3�=�渾���]��w������k��+~�QN��='��_]��֟������������>dG�,�-+�DLO����2%^�-f�����`�����(�U�l�Ïӭl0� v!��+\�XK'U�'����/&M����T���q�'��66����]���ِ9!����%>������G[��)���8w����{���uo�,���i!uR�'Ւ�:aQfl�<��... Ma�$��I���ba���O���۶hh�٘ӿc�{4!�Ƣ�i�$�&��"7:�]b�Ūޙ���ϩ��K�r㡶PA�S�鐏�/�K�c�آ����8N�7q};5FX�k��|��X�j�dD Ӌ�Y"�m�gaK�,�-�����|������^���+}y�������J��))[�ə�`�;�s�[/�W����]��ӽ|S�����g���`/#�Yԇ�fd$� B��.�g0>�#bq�d/�YQ�*3��9�"��Z��eo�X�d��3+�;�Z��9����m�,L�[Y�xV.B�,7/��5����e�~WC��� C'�7�`��7�Yߗ���� <�<�2U�gB�<����i6 J�e7�>��KkR���+��O?�eN�$�?)�ܼ��YO� �c �J�u�E�W�kz��4wO�ӯ�w=>����nTY��/�� ���b��>o��o2��&g�)�uɸ �dD��}ƽן'��\�r�uI��.Ѹ�� ^�s�ś��@i�3���� ����[4$�j>�^��RV��8L|�z��l�{:�cX_ 8+����?���E�2@+[���3" ��à�.��N� *ߧ-R?p+`�H;�?H%�>r��B��`�A%�h*��e�"���\��C�K�h�8J��L�R��;�%�A}�?��-t�;����]p���0�-��6�Ur���j㯩�Y�+^"�g���Go*����Sl��2ۃs��"�Q�։i�+/������� G��/���׀i��d�Bvtr�xH������u�3���#������=�=�N Ԩ��HC�a�} ���T�@��vpG�"���FDZ��t�`���N��br����B��8��0�+GD��z���b�6f��l�k1l��'�59�o���_=�頄�����6���#�S �+��4��fX �/lfX �a�:�[�t � �f:�\oņ�b����t��t��d~�x�|~�ǀ�V���3_�����q���݊�w�h�ۻ}3{g6��U��0o¿�\�O� xy����c��_�����X��:�~�*MR��.JeT/o�z �z�%J�G��������)��t-}J[�.5�]�����R/i��m�9ѫ^brbw�wA��m�����_����l�S��&m� �ģ���b� g0��M����ʰzT�^̵k��.^U_��~ ����I����ɛ�����a>��>��;=�ݓ��s,n�N ϫ����5�C߸�&����HzU��Β?Uw���"r�i�`��`8�Dd��1�̈��w���F�F*12���3�2Z��hb4�i�c@|����{Q�;�S���(m,�<y}����(w���'� �Z~� ���������7tP��C����>�W�SX�ȿ����i������x8N��o"q.!����8��*�揓Vq��Y%�nTDX�̀�O&im�~x�:��1}Fb\=�o��Sn� ���m ۦ��u�:�%ɴM|�* i�G��p�Qu���... Home | Activation Functions | Architectures | Assorted | Attention | Batch Norm | BERT | Classification | Convolutions | Decoder | Dropout | ELMo | Encoder | FFN | Gradient Descent | Initializations... These images were originally published in the book “Deep Learning with PyTorch Step-by-Step: A Beginner’s Guide”. They are also available at the book’s official repository: https://github.com/dvgodoy/PyTorchStepByStep.
This work is licensed under a Creative Commons Attribution 4.0 International License. Optimizers implement different techniques for performing gradient descent and aim to solve problems of noisy updates to perform smooth descent and faster convergence. The most basic version of gradient descent, here we take one example from the data set, calculate the loss, and perform one iteration of backprop. while($\lVert w_{t} - w_{t-1} \rVert > \epsilon$){ for($i = 1, \ldots, N$){ $w_{t} = w_{t-1} - \eta \nabla_{w} L(w_{t-1}, X_{i}, y_{i})$ } } where $\eta$ is the learning rate. Because it uses just one example for backprop, the updates can be very noisy, and getting the value of $\eta$ correct can be difficult.
$\epsilon$ is a pre defined threhold such that we will stop performing updates once the difference in weights is below this value. As an implementation note, the data indices are usually shuffled in a random order to avoid introducing any kind of bias to the system. (For instance, the data could be arranged such that all instances of one class come before another. In this case, the model will see a single class for a long time and will not learn to distinguish between the two, since it only needs to output one class for a long... There was an error while loading. Please reload this page.
You can create a release to package software, along with release notes and links to binary files, for other people to use. Learn more about releases in our docs. 🔗 Notebook Link: Coding Deep learning optimizers from scratch This project explores the optimization algorithms that are critical for training deep learning models. It includes:
People Also Search
- gio-assuncao/deep-learning-optimizers - GitHub
- GitHub - giassuncao/deep-learning-optimizers: A repository to organize ...
- gio-assuncao (Giovanna Assunção) · GitHub
- every single optimizer from every single github repo I found throughout ...
- DeepOBS - DeepOBS
- PDF DEEP LEARNING OPTIMIZERS - success-vera.github.io
- Optimizers and Schedulers | dl-visuals
- Optimizers - Learning Notes - GitHub Pages
- Releases · gio-assuncao/deep-learning-optimizers · GitHub
- Coding Deep learning optimizers from scratch - Academic Homepage
A Repository To Make Available And Organize The Codes Developed
A repository to make available and organize the codes developed during the execution of a technical note on Medium about Optimization in Deep Learning. These codes enable practical visualization of the theoretical concepts covered in the work, this is part of the coursework for the Machine Learning course by professor Ivanovitch Medeiros. The code in the .ipynb files can be found under 'files' in ...
SGD Momentum E Nesterov: Code To Help Compare The Behavior
SGD Momentum e Nesterov: Code to help compare the behavior of SGD optimizer in three ways: normal, with momentum, and with Nesterov momentum. Analyzing gradients, path and loss functions. 3. Learning Rate Schedulers: Code to help understand the differences in a model training using learning rate schedulers, specifically StepLR and CyclicLR. A repository to make available and organize the codes dev...
The Code In The .ipynb Files Can Be Found Under
The code in the .ipynb files can be found under 'files' in this repository or accessed directly through these Google Colab links: 1. Visualizando Gradientes Adaptados: Code to help visualize the changes in gradients, corrected gradients, and adapted gradients throughout model training, using EWMA and the Adam optimizer. 2. SGD Momentum e Nesterov: Code to help compare the behavior of SGD optimizer...
3. Learning Rate Schedulers: Code To Help Understand The Differences
3. Learning Rate Schedulers: Code to help understand the differences in a model training using learning rate schedulers, specifically StepLR and CyclicLR. Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users. Contact GitHub support about this user’s behavior. Learn more about reporting abuse.
A Repository To Accompany My Reading Of The Book "Designing
A repository to accompany my reading of the book "Designing Machine Learning Systems" by Chip Huyen A repository to make available and organize the codes developed during the execution of a technical note on Medium about Optimization in Deep Learning A repository for my Machine Learning Course's Final Project Instantly share code, notes, and snippets. DeepOBS is a benchmarking suite that drastical...