Done challenge 3

diff --git a/2020-early/2020-a-challenge2.ipynb b/2020-early/2020-a-challenge2.ipynb
index 20c5da5de634cf820c0a2d11aced55b5330d481d..385076c077cab67dc0ef8ff35aab2685970dcecb 100644 (file)
--- a/2020-early/2020-a-challenge2.ipynb
+++ b/2020-early/2020-a-challenge2.ipynb
@@ -102,55 +102,45 @@
   },
   {
    "cell_type": "code",
-   "execution_count": 12,
+   "execution_count": 15,
    "metadata": {},
    "outputs": [
     {
      "name": "stdout",
      "output_type": "stream",
      "text": [
-      "(3, 6, True) \n",
+      "(3, 9, True) \n",
       "\n",
-      "PHIL I HEARD BACK FROM THE BRITISH MILITARY ATTACHE STOP HE SAID THAT THE NUMBER LOOKS LIKE THE FORMAT USED BY THE PATENT OFFICE STOP HE SUGGESTED THAT THE DOCUMENT MIGHT HAVE BEEN A DESIGN DRAWING FOR AN INVENTION STOP ONE OF OUR FIELD AGENTS TRIED TO FIND OUT WHICH ONE BUT THE NUMBERS LOOKED WRONG STOP PATENT NUMBERS STARTING GB EIGHT HAVE NOT BEEN ISSUED YET STOP THE AGENT HAD NOT SEEN THE PHOTO YOU SENT BUT SHE SHOWED INITIATIVE AND TRIED SOME OTHER NUMBERS STOP GB-SIX-THREE-ZERO-SEVEN-TWO-SIX-A WAS THE MOST PROMISING STOP CHECKED WITH OUR EXPERTS AND THEY WERE CONFUSED STOP ACCORDING TO COCKCROFT THE INVENTION IS IMPRACTICAL STOP SOMEONE POINTED OUT THAT IT FITS WITH THE NAME DIE ALCHEMISTEN STOP SEE ATTACHED STOP WILL INVESTIGATE FURTHER STOP NEXT COMMUNICATION IN SEVEN DAYS STOP\n",
+      "HARRY, I CHECKED OUT THE PATENT YOU ASKED ME ABOUT. I THINK IT MIGHT BE RELATED TO A LECTURE COCKCROFT DELIVERED AT THE INSTITUTE OF ELECTRICAL ENGINEERS ON APRIL TWENTY THIRD NINETEEN THIRTY SIX. THE TOPIC WAS \"THE TRANSMUTATION OF MATTER BY HIGH ENERGY PARTICLES AND RADIATIONS\". GIVEN THE LABEL ON THE HINDENBURG ENVELOPE I THINK THE FOLLOWING EXTRACT IS PARTICULARLY INTERESTING: \"IN THE CASE OF NUCLEAR TRANSMUTATIONS, IT SEEMS THAT THE LOSS OF MASS IS PRECISELY EQUAL TO THE INCREASE IN THE KINETIC ENERGY THAT HAS TAKEN PLACE. THIS GIVES A STRIKING PROOF OF THE MODERN PHYSICAL LAW THAT MASS AND ENERGY ARE EQUIVALENT. IN NINETEEN THIRTY TWO CHADWICK DISCOVERED THE NEUTRON, A NEW TYPE OF ATOMIC PARTICLE WHICH HAS NO ELECTRIC CHARGE. IT DOES NOT THEREFORE INTERACT WITH OTHER ELECTRONS AND PRODUCES NO IONISATION WHEN PASSING THROUGH A GAS. IT IS OF OUTSTANDING IMPORTANCE BECAUSE OF ITS POWER TO PRODUCE TRANSMUTATIONS. THERE IS LITTLE HOPE THAT THIS PROCESS CAN BE USED ON AN ENGINEERING SCALE TO CONVERT MASS INTO ENERGY. SO FAR, OUR LABORATORY EXPERIMENTS PRODUCE THE CONVERSE RESULT. THEORY INDICATES THAT AT TEMPERATURES EQUAL TO THOSE OF THE INTERIOR OF THE SUN OR STARS, IT MIGHT BE POSSIBLE TO CONVERT THE INEXPENSIVE SIMPLE ELEMENTS TO THE MORE VALUABLE HEAVIER COMBINATIONS, BUT PRACTICALLY, THERE IS NO METHOD OF PRODUCING THE EFFECTS FORMERLY ATTRIBUTED TO THE 'PHILOSOPHER'S STONE'.\"\n",
       "\n"
      ]
     }
    ],
    "source": [
     "(mb, cb, zb), score_a = affine_break(scb)\n",
-    "print((mb, cb, z) '\\n')\n",
-    "pa = repunctuate(affine_decipher(sca, ma, ca, za), pta)\n",
-    "print(pa)"
+    "print((mb, cb, zb), '\\n')\n",
+    "pb = repunctuate(affine_decipher(scb, mb, cb, zb), ptb)\n",
+    "print(pb)"
    ]
   },
   {
    "cell_type": "code",
-   "execution_count": 9,
+   "execution_count": 16,
    "metadata": {},
    "outputs": [
     {
-     "name": "stdout",
-     "output_type": "stream",
-     "text": [
-      "21 \n",
-      "\n",
-      "HARRY,\n",
-      "I AM REALLY SORRY TO BOTHER YOU, BUT SOMETHING HAS COME UP AND THE SIS ARE TOO BUSY TO HELP. I AM HOPING YOU CAN.\n",
-      "FOLLOWING THE INVASION OF POLAND, WE ARE ALL ON DOUBLE DUTY, TRAWLING THROUGH OLD FILES FOR ANYTHING THAT MIGHT BE USEFUL TO OUR FRIENDS IN EUROPE. MY TEAM HAS BEEN ASKED TO LOOK AT INTELLIGENCE FILES CONNECTED WITH AIR TRANSPORT AND I WAS GIVEN THE HINDENBURG DISASTER TO CHECK OUT.\n",
-      "THERE ISN'T MUCH TO GO ON AS MOST OF THE PAPERS RECOVERED FROM THE WRECKAGE WERE BADLY DAMAGED. WE DO HAVE A LARGE NUMBER OF FRAGMENTS OF TRAVEL DOCUMENTS WHICH I HAVE SENT TO THE STATE DEPARTMENT FOR ID CHECKS, BUT THAT WILL TAKE A WHILE, AND IN THE MEANTIME, I HAVE BEEN EXAMINING SOME OF THE MORE UNUSUAL ITEMS.\n",
-      "THE MOST INTERESTING ONE IS A CHARRED ENVELOPE CARRYING A SWASTIKA AND MARKED DIE ALCHEMISTEN. I THINK THAT MIGHT BE WORTH INVESTIGATING.\n",
-      "THE CONTENTS WERE MISSING, BUT IN THE SAME EVIDENCE BAG I FOUND A FRAGMENT OF TORN BLUE PAPER WITH A NUMBER IN THE BOTTOM CORNER. THERE IS NO DESCRIPTION WITH IT, BUT I AM GUESSING THAT THEY MUST HAVE BEEN FOUND TOGETHER. WATER HAS DISSOLVED AND OBSCURED THE NUMBER SO I CAN'T READ IT AND I DON'T RECOGNISE THE FORMAT. ON THE OTHER HAND, THE WATER MUST HAVE PROTECTED IT FROM THE HEAT OF THE FLAMES AS THERE ARE NO BURN MARKS AND I WONDERED IF YOUR X-RAY TEAM MIGHT BE ABLE TO ASSIST.\n",
-      "HAVE YOU SEEN ANYTHING LIKE IT BEFORE, OR HAVE YOU HEARD OF DIE ALCHEMISTEN? ANYTHING YOU HAVE WOULD BE GREAT. THANKS\n",
-      "PHIL\n",
-      "\n"
-     ]
+     "data": {
+      "text/plain": [
+       "1406"
+      ]
+     },
+     "execution_count": 16,
+     "metadata": {},
+     "output_type": "execute_result"
     }
    ],
    "source": [
-    "k_a, score_b = caesar_break(ca)\n",
-    "print(k_a, '\\n')\n",
-    "pa = caesar_decipher(ca, k_a)\n",
-    "print(pa)"
+    "open(plaintext_b_filename, 'w').write(pb)"
    ]
   },
   {

diff --git a/2020-early/2020-a-challenge3.ipynb b/2020-early/2020-a-challenge3.ipynb
new file mode 100644 (file)
index 0000000..0c65ac3
--- /dev/null
+++ b/2020-early/2020-a-challenge3.ipynb
@@ -0,0 +1,212 @@
+{
+ "cells": [
+  {
+   "cell_type": "code",
+   "execution_count": 1,
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "import os,sys,inspect\n",
+    "currentdir = os.path.dirname(os.path.abspath(inspect.getfile(inspect.currentframe())))\n",
+    "parentdir = os.path.dirname(currentdir)\n",
+    "sys.path.insert(0,parentdir) "
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 6,
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "from cipher.caesar import *\n",
+    "from cipher.affine import *\n",
+    "from cipher.keyword_cipher import *\n",
+    "\n",
+    "from support.text_prettify import *\n",
+    "from support.utilities import *\n",
+    "from support.plot_frequency_histogram import *"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 3,
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "challenge_number = 3\n",
+    "plaintext_a_filename = f'{challenge_number}a.plaintext'\n",
+    "plaintext_b_filename = f'{challenge_number}b.plaintext'\n",
+    "ciphertext_a_filename = f'{challenge_number}a.ciphertext'\n",
+    "ciphertext_b_filename = f'{challenge_number}b.ciphertext'"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 18,
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "ca = open(ciphertext_a_filename).read()\n",
+    "cb = open(ciphertext_b_filename).read()\n",
+    "\n",
+    "sca = sanitise(ca)\n",
+    "pca = letters(ca)\n",
+    "pta = depunctuate(ca)\n",
+    "\n",
+    "scb = sanitise(cb)\n",
+    "pcb = letters(cb)\n",
+    "ptb = depunctuate(cb)"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 20,
+   "metadata": {},
+   "outputs": [
+    {
+     "data": {
+      "text/plain": [
+       "('problem', <KeywordWrapAlphabet.from_largest: 3>)"
+      ]
+     },
+     "execution_count": 20,
+     "metadata": {},
+     "output_type": "execute_result"
+    }
+   ],
+   "source": [
+    "(kworda, kwrapa), score = keyword_break_mp(sca, fitness=Ptrigrams)\n",
+    "kworda, kwrapa"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 23,
+   "metadata": {},
+   "outputs": [
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "harry,\n",
+      "i don't think this is about alchemy. the energy and raw materials required to produce valuable elements are far too expensive to make this practical, and no-one knows how to do it. it is possible that die alchemisten are focussed on this, but if so they are no threat to anyone at the moment. that doesn't mean we have nothing to worry about. the patent filed by leo szilard was for a prototype nuclear reactor. szilard is an engineer and physicist, and saw cockroft's claim that the nuclear transmutation reaction could not yield energy \"on an engineering scale\" as a challenge to be beaten. transmutation occurs when an atom is hit by an energetic neutron, and his idea was to trigger a process using lighter elements that produce a lot of neutrons as well as energy when hit, so that the process is self-sustaining. so far, his attempts to use elements like beryllium and indium have been unsuccessful, but in the last year hahn and strassman succeeded where he failed, using uranium, and it is possible that this could lead to a practical energy generation process. if that is what die alchemisten are working on then we have a much bigger problem. nuclear processes yield a million times more energy for each gram of fuel than the current chemical reactions like burning coal, and if the nazis could harness that then their steel and aluminium production would massively increase giving them a huge advantage in war. we don't know how far they have got with this technology, but i think we should assume that they are ahead of us and try to find out how far.\n",
+      "\n"
+     ]
+    }
+   ],
+   "source": [
+    "pa = keyword_decipher(ca, kworda, kwrapa)\n",
+    "print(pa)"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 24,
+   "metadata": {},
+   "outputs": [
+    {
+     "data": {
+      "text/plain": [
+       "1571"
+      ]
+     },
+     "execution_count": 24,
+     "metadata": {},
+     "output_type": "execute_result"
+    }
+   ],
+   "source": [
+    "open(plaintext_a_filename, 'w').write(pa)"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 25,
+   "metadata": {},
+   "outputs": [
+    {
+     "data": {
+      "text/plain": [
+       "('borealis', <KeywordWrapAlphabet.from_last: 2>)"
+      ]
+     },
+     "execution_count": 25,
+     "metadata": {},
+     "output_type": "execute_result"
+    }
+   ],
+   "source": [
+    "(kwordb, kwrapb), score = keyword_break_mp(scb, fitness=Ptrigrams)\n",
+    "kwordb, kwrapb"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 26,
+   "metadata": {},
+   "outputs": [
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "phil, i am heading to sweden to speak with lise meitner. she was part of the team who split the atom and together with frisch has worked out the details of how it works. she is a brilliant chemist as well as a physicist and i am hoping she can shed some light on how likely it is that that die alchemisten could develop a nuclear power generation system from the process.\n",
+      "on the way back, i plan to also visit some people i know in norway. a new power source will be of no use to the nazis without the raw materials for manufacturing, and a lot of the major bauxite smelters in europe are based in the country. even without a new source of power the german military planners will have their eye on supply lines and the norwegian aluminium companies must be one of their prime targets. i thought i would drop in and try to get a sense of how well defended these places are. there may already have been approaches from germany as part of their arms build-up and it would be good to know that too. if the worst happens and norway is invaded, then i want to have some agents already embedded in the national infrastructure and we need to think about how we would secure communications in an occupied country. if you or the agency have any contacts there then let me know. with a little luck i may even get to see the northern lights while i am there.\n",
+      "\n"
+     ]
+    }
+   ],
+   "source": [
+    "pb = keyword_decipher(cb, kwordb, kwrapb)\n",
+    "print(pb)"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 27,
+   "metadata": {},
+   "outputs": [
+    {
+     "data": {
+      "text/plain": [
+       "1347"
+      ]
+     },
+     "execution_count": 27,
+     "metadata": {},
+     "output_type": "execute_result"
+    }
+   ],
+   "source": [
+    "open(plaintext_b_filename, 'w').write(pb)"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "metadata": {},
+   "outputs": [],
+   "source": []
+  }
+ ],
+ "metadata": {
+  "kernelspec": {
+   "display_name": "Python 3",
+   "language": "python",
+   "name": "python3"
+  },
+  "language_info": {
+   "codemirror_mode": {
+    "name": "ipython",
+    "version": 3
+   },
+   "file_extension": ".py",
+   "mimetype": "text/x-python",
+   "name": "python",
+   "nbconvert_exporter": "python",
+   "pygments_lexer": "ipython3",
+   "version": "3.7.4"
+  }
+ },
+ "nbformat": 4,
+ "nbformat_minor": 4
+}

diff --git a/2020-early/3a.ciphertext b/2020-early/3a.ciphertext
new file mode 100644 (file)
index 0000000..1bb93fc
--- /dev/null
+++ b/2020-early/3a.ciphertext
@@ -0,0 +1,2 @@
+SPDDN,
+T BZY'G GSTYV GSTF TF PRZHG PWOSLXN. GSL LYLDMN PYB DPJ XPGLDTPWF DLCHTDLB GZ ADZBHOL IPWHPRWL LWLXLYGF PDL EPD GZZ LKALYFTIL GZ XPVL GSTF ADPOGTOPW, PYB YZ-ZYL VYZJF SZJ GZ BZ TG. TG TF AZFFTRWL GSPG BTL PWOSLXTFGLY PDL EZOHFFLB ZY GSTF, RHG TE FZ GSLN PDL YZ GSDLPG GZ PYNZYL PG GSL XZXLYG. GSPG BZLFY'G XLPY JL SPIL YZGSTYM GZ JZDDN PRZHG. GSL APGLYG ETWLB RN WLZ FQTWPDB JPF EZD P ADZGZGNAL YHOWLPD DLPOGZD. FQTWPDB TF PY LYMTYLLD PYB ASNFTOTFG, PYB FPJ OZOVDZEG'F OWPTX GSPG GSL YHOWLPD GDPYFXHGPGTZY DLPOGTZY OZHWB YZG NTLWB LYLDMN "ZY PY LYMTYLLDTYM FOPWL" PF P OSPWWLYML GZ RL RLPGLY. GDPYFXHGPGTZY ZOOHDF JSLY PY PGZX TF STG RN PY LYLDMLGTO YLHGDZY, PYB STF TBLP JPF GZ GDTMMLD P ADZOLFF HFTYM WTMSGLD LWLXLYGF GSPG ADZBHOL P WZG ZE YLHGDZYF PF JLWW PF LYLDMN JSLY STG, FZ GSPG GSL ADZOLFF TF FLWE-FHFGPTYTYM. FZ EPD, STF PGGLXAGF GZ HFL LWLXLYGF WTVL RLDNWWTHX PYB TYBTHX SPIL RLLY HYFHOOLFFEHW, RHG TY GSL WPFG NLPD SPSY PYB FGDPFFXPY FHOOLLBLB JSLDL SL EPTWLB, HFTYM HDPYTHX, PYB TG TF AZFFTRWL GSPG GSTF OZHWB WLPB GZ P ADPOGTOPW LYLDMN MLYLDPGTZY ADZOLFF. TE GSPG TF JSPG BTL PWOSLXTFGLY PDL JZDVTYM ZY GSLY JL SPIL P XHOS RTMMLD ADZRWLX. YHOWLPD ADZOLFFLF NTLWB P XTWWTZY GTXLF XZDL LYLDMN EZD LPOS MDPX ZE EHLW GSPY GSL OHDDLYG OSLXTOPW DLPOGTZYF WTVL RHDYTYM OZPW, PYB TE GSL YPQTF OZHWB SPDYLFF GSPG GSLY GSLTD FGLLW PYB PWHXTYTHX ADZBHOGTZY JZHWB XPFFTILWN TYODLPFL MTITYM GSLX P SHML PBIPYGPML TY JPD. JL BZY'G VYZJ SZJ EPD GSLN SPIL MZG JTGS GSTF GLOSYZWZMN, RHG T GSTYV JL FSZHWB PFFHXL GSPG GSLN PDL PSLPB ZE HF PYB GDN GZ ETYB ZHG SZJ EPD.

diff --git a/2020-early/3a.plaintext b/2020-early/3a.plaintext
new file mode 100644 (file)
index 0000000..7493fef
--- /dev/null
+++ b/2020-early/3a.plaintext
@@ -0,0 +1,2 @@
+harry,
+i don't think this is about alchemy. the energy and raw materials required to produce valuable elements are far too expensive to make this practical, and no-one knows how to do it. it is possible that die alchemisten are focussed on this, but if so they are no threat to anyone at the moment. that doesn't mean we have nothing to worry about. the patent filed by leo szilard was for a prototype nuclear reactor. szilard is an engineer and physicist, and saw cockroft's claim that the nuclear transmutation reaction could not yield energy "on an engineering scale" as a challenge to be beaten. transmutation occurs when an atom is hit by an energetic neutron, and his idea was to trigger a process using lighter elements that produce a lot of neutrons as well as energy when hit, so that the process is self-sustaining. so far, his attempts to use elements like beryllium and indium have been unsuccessful, but in the last year hahn and strassman succeeded where he failed, using uranium, and it is possible that this could lead to a practical energy generation process. if that is what die alchemisten are working on then we have a much bigger problem. nuclear processes yield a million times more energy for each gram of fuel than the current chemical reactions like burning coal, and if the nazis could harness that then their steel and aluminium production would massively increase giving them a huge advantage in war. we don't know how far they have got with this technology, but i think we should assume that they are ahead of us and try to find out how far.

diff --git a/2020-early/3b.ciphertext b/2020-early/3b.ciphertext
new file mode 100644 (file)
index 0000000..0252112
--- /dev/null
+++ b/2020-early/3b.ciphertext
@@ -0,0 +1,2 @@
+CSTW, T BX SABETYI HZ GMAEAY HZ GCABV MTHS WTGA XATHYAF. GSA MBG CBFH ZL HSA HABX MSZ GCWTH HSA BHZX BYE HZIAHSAF MTHS LFTGRS SBG MZFVAE ZJH HSA EAHBTWG ZL SZM TH MZFVG. GSA TG B OFTWWTBYH RSAXTGH BG MAWW BG B CSPGTRTGH BYE T BX SZCTYI GSA RBY GSAE GZXA WTISH ZY SZM WTVAWP TH TG HSBH HSBH ETA BWRSAXTGHAY RZJWE EAKAWZC B YJRWABF CZMAF IAYAFBHTZY GPGHAX LFZX HSA CFZRAGG.
+ZY HSA MBP OBRV, T CWBY HZ BWGZ KTGTH GZXA CAZCWA T VYZM TY YZFMBP. B YAM CZMAF GZJFRA MTWW OA ZL YZ JGA HZ HSA YBQTG MTHSZJH HSA FBM XBHAFTBWG LZF XBYJLBRHJFTYI, BYE B WZH ZL HSA XBUZF OBJNTHA GXAWHAFG TY AJFZCA BFA OBGAE TY HSA RZJYHFP. AKAY MTHSZJH B YAM GZJFRA ZL CZMAF HSA IAFXBY XTWTHBFP CWBYYAFG MTWW SBKA HSATF APA ZY GJCCWP WTYAG BYE HSA YZFMAITBY BWJXTYTJX RZXCBYTAG XJGH OA ZYA ZL HSATF CFTXA HBFIAHG. T HSZJISH T MZJWE EFZC TY BYE HFP HZ IAH B GAYGA ZL SZM MAWW EALAYEAE HSAGA CWBRAG BFA. HSAFA XBP BWFABEP SBKA OAAY BCCFZBRSAG LFZX IAFXBYP BG CBFH ZL HSATF BFXG OJTWE-JC BYE TH MZJWE OA IZZE HZ VYZM HSBH HZZ. TL HSA MZFGH SBCCAYG BYE YZFMBP TG TYKBEAE, HSAY T MBYH HZ SBKA GZXA BIAYHG BWFABEP AXOAEEAE TY HSA YBHTZYBW TYLFBGHFJRHJFA BYE MA YAAE HZ HSTYV BOZJH SZM MA MZJWE GARJFA RZXXJYTRBHTZYG TY BY ZRRJCTAE RZJYHFP. TL PZJ ZF HSA BIAYRP SBKA BYP RZYHBRHG HSAFA HSAY WAH XA VYZM. MTHS B WTHHWA WJRV T XBP AKAY IAH HZ GAA HSA YZFHSAFY WTISHG MSTWA T BX HSAFA.

diff --git a/2020-early/3b.plaintext b/2020-early/3b.plaintext
new file mode 100644 (file)
index 0000000..b08203c
--- /dev/null
+++ b/2020-early/3b.plaintext
@@ -0,0 +1,2 @@
+phil, i am heading to sweden to speak with lise meitner. she was part of the team who split the atom and together with frisch has worked out the details of how it works. she is a brilliant chemist as well as a physicist and i am hoping she can shed some light on how likely it is that that die alchemisten could develop a nuclear power generation system from the process.
+on the way back, i plan to also visit some people i know in norway. a new power source will be of no use to the nazis without the raw materials for manufacturing, and a lot of the major bauxite smelters in europe are based in the country. even without a new source of power the german military planners will have their eye on supply lines and the norwegian aluminium companies must be one of their prime targets. i thought i would drop in and try to get a sense of how well defended these places are. there may already have been approaches from germany as part of their arms build-up and it would be good to know that too. if the worst happens and norway is invaded, then i want to have some agents already embedded in the national infrastructure and we need to think about how we would secure communications in an occupied country. if you or the agency have any contacts there then let me know. with a little luck i may even get to see the northern lights while i am there.